2024-08-31T11:58:15.015 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T11:58:15.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T11:58:15.137 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} email: mchangir@redhat.com first_in_suite: false job_id: '7881495' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Replacing daemon mds sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKN3yDkbZHSJgUI6ieHrklQZ9Vm61iFZZcHCFexEflKJUyHTjn5eRmFEuW8M2juZVJZaV/orOGdCo8km5mJ27k8= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSSu9agWFpkuC6uj6tys7u2nS9uZJTcGA3WvtMg0emMMxjl1YIgRCCGBTBrNTM58s8A1zFxrkNH+lHzS+tI20o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mds_thrash: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T11:58:15.138 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T11:58:15.138 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T11:58:15.139 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T11:58:15.140 INFO:teuthology.task.internal:Checking packages... 2024-08-31T11:58:15.162 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T11:58:15.162 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T11:58:15.162 INFO:teuthology.packaging:ref: None 2024-08-31T11:58:15.162 INFO:teuthology.packaging:tag: None 2024-08-31T11:58:15.162 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T11:58:15.162 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T11:58:15.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T11:58:15.311 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560-gd19e6118-1jammy 2024-08-31T11:58:15.312 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T11:58:15.318 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T11:58:15.318 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T11:58:15.346 INFO:teuthology.task.internal:Saving configuration 2024-08-31T11:58:15.365 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T11:58:15.371 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T11:58:15.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 11:52:38.918872', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOdhYU7+5evZYv3H61rANopYLoHaHqovYoTkyMRgbVnK'} 2024-08-31T11:58:15.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 11:52:38.920467', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFPufJ9ihiqpJClQ83RQ07Lwp2Th4+ePTDFCIPqj7DLM'} 2024-08-31T11:58:15.420 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T11:58:15.426 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-08-31T11:58:15.426 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-08-31T11:58:15.426 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T11:58:15.521 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f073a3ac0>, signals=[15]) 2024-08-31T11:58:15.521 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T11:58:15.526 INFO:teuthology.task.internal:Opening connections... 2024-08-31T11:58:15.526 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T11:58:15.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T11:58:15.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T11:58:15.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T11:58:15.690 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T11:58:15.696 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-08-31T11:58:15.701 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-08-31T11:58:15.702 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-08-31T11:58:15.750 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T11:58:15.750 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2024-08-31T11:58:15.750 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2024-08-31T11:58:15.750 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T11:58:15.751 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2024-08-31T11:58:15.752 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-08-31T11:58:15.775 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-08-31T11:58:15.780 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-08-31T11:58:15.781 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2024-08-31T11:58:15.830 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T11:58:15.831 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2024-08-31T11:58:15.831 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-08-31T11:58:15.849 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T11:58:15.857 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T11:58:15.861 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T11:58:15.862 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-08-31T11:58:15.864 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-08-31T11:58:15.877 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T11:58:15.882 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T11:58:15.883 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-08-31T11:58:15.911 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-08-31T11:58:15.937 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T11:58:15.990 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T11:58:16.003 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-31T11:58:16.004 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-31T11:58:16.004 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-31T11:58:16.004 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T11:58:16.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T11:58:16.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-08-31T11:58:16.172 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T11:58:16.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-08-31T11:58:16.172 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-08-31T11:58:16.178 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-56-generic 2024-08-31T11:58:16.178 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T11:58:16.179 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-31T11:58:16.179 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-08-31T11:58:16.179 DEBUG:teuthology.orchestra.run.smithi164:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-08-31T11:58:16.247 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-08-31T11:58:16.401 INFO:teuthology.orchestra.run.smithi164.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-31T11:58:16.401 INFO:teuthology.orchestra.run.smithi164.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: git config --global init.defaultBranch 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2024-08-31T11:58:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:hint: git branch -m 2024-08-31T11:58:16.403 INFO:teuthology.orchestra.run.smithi164.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-08-31T11:58:16.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-08-31T11:58:16.468 DEBUG:teuthology.orchestra.run.smithi164:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-08-31T11:58:16.523 DEBUG:teuthology.orchestra.run.smithi164:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-08-31T11:58:37.573 INFO:teuthology.orchestra.run.smithi164.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-08-31T11:58:37.574 INFO:teuthology.orchestra.run.smithi164.stderr: * [new branch] main -> origin/main 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190312 -> 20190312 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190416 -> 20190416 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190514 -> 20190514 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190618 -> 20190618 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190717 -> 20190717 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190815 -> 20190815 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190923 -> 20190923 2024-08-31T11:58:37.610 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20191022 -> 20191022 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20191215 -> 20191215 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200122 -> 20200122 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200316 -> 20200316 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200421 -> 20200421 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200519 -> 20200519 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200619 -> 20200619 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200721 -> 20200721 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200817 -> 20200817 2024-08-31T11:58:37.612 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200918 -> 20200918 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201022 -> 20201022 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201118 -> 20201118 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201218 -> 20201218 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210208 -> 20210208 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210315 -> 20210315 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210511 -> 20210511 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210716 -> 20210716 2024-08-31T11:58:37.615 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210818 -> 20210818 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210919 -> 20210919 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20211027 -> 20211027 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20211216 -> 20211216 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220209 -> 20220209 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220310 -> 20220310 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220411 -> 20220411 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220509 -> 20220509 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220610 -> 20220610 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220708 -> 20220708 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220815 -> 20220815 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220913 -> 20220913 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221012 -> 20221012 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221109 -> 20221109 2024-08-31T11:58:37.616 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221214 -> 20221214 2024-08-31T11:58:37.617 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230117 -> 20230117 2024-08-31T11:58:37.617 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230210 -> 20230210 2024-08-31T11:58:37.617 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230310 -> 20230310 2024-08-31T11:58:37.617 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230404 -> 20230404 2024-08-31T11:58:37.617 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230515 -> 20230515 2024-08-31T11:58:37.618 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230625 -> 20230625 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230804 -> 20230804 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230919 -> 20230919 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20231030 -> 20231030 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20231111 -> 20231111 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20231211 -> 20231211 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240115 -> 20240115 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240220 -> 20240220 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240312 -> 20240312 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240410 -> 20240410 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240513 -> 20240513 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240610 -> 20240610 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240709 -> 20240709 2024-08-31T11:58:37.619 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20240811 -> 20240811 2024-08-31T11:58:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:Updating files: 44% (1557/3491) Updating files: 45% (1571/3491) Updating files: 46% (1606/3491) Updating files: 47% (1641/3491) Updating files: 48% (1676/3491) Updating files: 49% (1711/3491) Updating files: 50% (1746/3491) Updating files: 51% (1781/3491) Updating files: 52% (1816/3491) Updating files: 53% (1851/3491) Updating files: 54% (1886/3491) Updating files: 55% (1921/3491) Updating files: 56% (1955/3491) Updating files: 57% (1990/3491) Updating files: 58% (2025/3491) Updating files: 59% (2060/3491) Updating files: 59% (2063/3491) Updating files: 60% (2095/3491) Updating files: 61% (2130/3491) Updating files: 62% (2165/3491) Updating files: 63% (2200/3491) Updating files: 64% (2235/3491) Updating files: 65% (2270/3491) Updating files: 66% (2305/3491) Updating files: 67% (2339/3491) Updating files: 68% (2374/3491) Updating files: 69% (2409/3491) Updating files: 69% (2420/3491) Updating files: 70% (2444/3491) Updating files: 71% (2479/3491) Updating files: 72% (2514/3491) Updating files: 73% (2549/3491) Updating files: 74% (2584/3491) Updating files: 75% (2619/3491) Updating files: 76% (2654/3491) Updating files: 77% (2689/3491) Updating files: 78% (2723/3491) Updating files: 79% (2758/3491) Updating files: 80% (2793/3491) Updating files: 81% (2828/3491) Updating files: 82% (2863/3491) Updating files: 82% (2884/3491) Updating files: 83% (2898/3491) Updating files: 84% (2933/3491) Updating files: 85% (2968/3491) Updating files: 86% (3003/3491) Updating files: 87% (3038/3491) Updating files: 88% (3073/3491) Updating files: 89% (3107/3491) Updating files: 90% (3142/3491) Updating files: 91% (3177/3491) Updating files: 92% (3212/3491) Updating files: 93% (3247/3491) Updating files: 94% (3282/3491) Updating files: 95% (3317/3491) Updating files: 96% (3352/3491) Updating files: 97% (3387/3491) Updating files: 98% (3422/3491) Updating files: 99% (3457/3491) Updating files: 100% (3491/3491) Updating files: 100% (3491/3491), done. 2024-08-31T11:58:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:HEAD is now at f4c18f9f Merge branch 'amd-staging' into 'main' 2024-08-31T11:58:42.160 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T11:58:42.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T11:58:42.307 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T11:58:42.307 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g8ad8b8b16098_6.11.0-rc5-g8ad8b8b16098-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/ --input-file=- 2024-08-31T11:58:42.310 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-08-31T11:58:43.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31 11:58:42 URL:https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/linux-image-6.11.0-rc5-g8ad8b8b16098_6.11.0-rc5-g8ad8b8b16098-1_amd64.deb [45334904/45334904] -> "/tmp/linux-image.deb" [1] 2024-08-31T11:58:43.290 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2024-08-31 11:58:42-- 2024-08-31T11:58:43.291 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 1.0s 2024-08-31T11:58:43.291 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 43M in 0.8s (51.7 MB/s) 2024-08-31T11:58:43.294 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T11:58:43.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo dpkg -i /tmp/linux-image.deb 2024-08-31T11:58:43.543 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g8ad8b8b16098. 2024-08-31T11:58:45.525 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-08-31T11:58:45.531 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-08-31T11:58:45.693 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-6.11.0-rc5-g8ad8b8b16098 (6.11.0-rc5-g8ad8b8b16098-1) ... 2024-08-31T11:58:49.650 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-6.11.0-rc5-g8ad8b8b16098 (6.11.0-rc5-g8ad8b8b16098-1) ... 2024-08-31T11:58:49.778 INFO:teuthology.orchestra.run.smithi164.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:13.242 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2024-08-31T11:59:13.258 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T11:59:13.320 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-08-31T11:59:13.691 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:13.719 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.075 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T11:59:14.081 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T11:59:14.159 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T11:59:14.165 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T11:59:14.310 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T11:59:14.310 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T11:59:14.310 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T11:59:14.356 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-08-31T11:59:14.550 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-deb -c /tmp/linux-image.deb 2024-08-31T11:59:14.558 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./ 2024-08-31T11:59:14.558 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./boot/ 2024-08-31T11:59:14.558 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7098725 2024-08-27 12:59 ./boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 174121 2024-08-27 12:59 ./boot/config-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13292544 2024-08-27 12:59 ./boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/postinst.d/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/postrm.d/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/preinst.d/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/prerm.d/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/ 2024-08-31T11:59:14.599 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/ 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 189809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/aesni-intel.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 155337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-31T11:59:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/ 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/ 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/ 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpuid.ko 2024-08-31T11:59:14.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/msr.ko 2024-08-31T11:59:14.602 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/ 2024-08-31T11:59:14.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 505169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-31T11:59:14.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1060585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-31T11:59:14.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2858865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/af_alg.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/algif_hash.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/algif_skcipher.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/asymmetric_keys/ 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/ 2024-08-31T11:59:14.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-08-31T11:59:14.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cryptd.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_simd.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-08-31T11:59:14.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lrw.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 169521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-08-31T11:59:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xts.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_extlog.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/apei/ 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/apei/einj.ko 2024-08-31T11:59:14.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 105105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-08-31T11:59:14.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-08-31T11:59:14.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_legacy.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-08-31T11:59:14.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_radisys.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rz1000.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-08-31T11:59:14.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/ 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 161225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/ 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/ 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 141025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/ 2024-08-31T11:59:14.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1240825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 203657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/ 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 143337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/ 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 133345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-08-31T11:59:14.680 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 312817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/ 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 117753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/ 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/applicom.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/ 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-31T11:59:14.681 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 183745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 179465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/ 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/nvram.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-08-31T11:59:14.682 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/ 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/ 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_class.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_core.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-08-31T11:59:14.683 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/ 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-palmas.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-si5351.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-twl6040.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-wm831x.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/ 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 334505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-08-31T11:59:14.684 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 833113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ 2024-08-31T11:59:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/ 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 147345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-08-31T11:59:14.686 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/ 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-gpio.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max14577.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max77693.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max8997.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-palmas.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-rt8973a.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-sm5502.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/ 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/dmi-sysfs.ko 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/efi/ 2024-08-31T11:59:14.687 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/efi/efi-pstore.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/ 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-adp5520.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-amd8111.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-arizona.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-da9052.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-da9055.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-dln2.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-f7188x.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-generic.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-08-31T11:59:14.688 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-kempld.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-lp3943.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max7300.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max730x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max732x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-pca953x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-pcf857x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-rdc321x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-sch.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-sch311x.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-tps65912.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-twl4030.ko 2024-08-31T11:59:14.689 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-twl6040.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-vx855.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm831x.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm8350.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm8994.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/ 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-a4tech.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-apple.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-belkin.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cherry.ko 2024-08-31T11:59:14.690 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-chicony.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cp2112.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cypress.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ezkey.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-generic.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-31T11:59:14.691 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kensington.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lg-g15.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech.ko 2024-08-31T11:59:14.692 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-magicmouse.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-microsoft.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-monterey.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ntrig.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-08-31T11:59:14.693 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-08-31T11:59:14.694 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-08-31T11:59:14.695 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 184865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 462849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/ 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 153953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbhid.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbkbd.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbmouse.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 261241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/ 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 96073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-08-31T11:59:14.696 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 378337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-08-31T11:59:14.697 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-08-31T11:59:14.698 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/da9052-hwmon.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/da9055-hwmon.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc2103.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-08-31T11:59:14.699 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hih6130.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 150681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/jc42.ko 2024-08-31T11:59:14.700 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 86561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-08-31T11:59:14.701 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 131585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-08-31T11:59:14.702 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mc13783-adc.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 140657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-31T11:59:14.703 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-08-31T11:59:14.704 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-08-31T11:59:14.705 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 96665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 116873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 134513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-08-31T11:59:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/ 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/ 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/ 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-08-31T11:59:14.707 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-31T11:59:14.708 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-31T11:59:14.709 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/ 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 328633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1107329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-31T11:59:14.710 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 404889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 343753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 591177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 515585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 919921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 375761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ocrdma/ 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 203241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-08-31T11:59:14.711 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/usnic/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 212353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 334665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 132457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 158257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 157209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-31T11:59:14.712 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/ 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/evbug.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/ff-memless.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/ 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/ 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-31T11:59:14.713 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lkkbd.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lm8323.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lm8333.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/newtonkbd.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/qt1070.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/qt2160.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-08-31T11:59:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/stowaway.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/sunkbd.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/xtkbd.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/matrix-keymap.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/ 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 160569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 114801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/gpio_mouse.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 430033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/psmouse.ko 2024-08-31T11:59:14.715 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/ 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 139497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ct82c710.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/parkbd.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/pcips2.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ps2mult.ko 2024-08-31T11:59:14.716 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serport.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/ 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-88pm860x.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-adp5520.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-bd2802.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-da903x.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-da9052.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-gpio.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3533.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm355x.ko 2024-08-31T11:59:14.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3642.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp8788.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-max8997.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-mc13783.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-menf21bmc.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca9532.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca955x.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca963x.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-tca6507.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-wm831x-status.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-wm8350.ko 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ 2024-08-31T11:59:14.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/ 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/ 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 776777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bufio.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-08-31T11:59:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 197121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 137841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-era.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-mirror.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 96937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 86937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-region-hash.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-08-31T11:59:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 139257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-snapshot.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 234353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-zero.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/ 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 257025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 157401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 443385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/ 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/ 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 211273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-08-31T11:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 150977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/ 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm800.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm805.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm80x.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/arizona-i2c.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 146569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/arizona.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/bcm590xx.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/cros_ec_dev.ko 2024-08-31T11:59:14.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/dln2.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/janz-cmodio.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/kempld-core.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lm3533-core.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lp3943.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/max8907.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mc13xxx-core.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/menf21bmc.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633-adc.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633-gpio.ko 2024-08-31T11:59:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/retu-mfd.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/si476x-core.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/tps65010.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/tps6507x.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wm8994.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-08-31T11:59:14.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ad525x_dpot.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/ 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/ 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/core.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/ 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ds1682.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/dummy-irq.ko 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/echo/ 2024-08-31T11:59:14.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/echo/echo.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/ 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/genwqe/ 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 191761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hmc6352.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ibmasm/ 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 92489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ics932s401.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-08-31T11:59:14.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/ 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/ 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 153777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 381905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/phantom.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ti-st/ 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ti-st/st_drv.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-08-31T11:59:14.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 232257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 623361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 133161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/ 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 592833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-08-31T11:59:14.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/ 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 158537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 86233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/ 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-31T11:59:14.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 116105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 128625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-31T11:59:14.730 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 110505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/ 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/ 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 229409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-08-31T11:59:14.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1734265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 166913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/ 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 164665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 439633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/ 2024-08-31T11:59:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 432417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 257433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 444721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1309441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 207073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/ 2024-08-31T11:59:14.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/ 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 269777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/ 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/ 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 169313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/ 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-08-31T11:59:14.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ec_bhf.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 356153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fujitsu/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 366465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/ 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 755425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-31T11:59:14.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/ 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 324721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/ 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1193705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/ 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 356609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/ 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 672177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/ 2024-08-31T11:59:14.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 121609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 966193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 193889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/ 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/ 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 5969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/ 2024-08-31T11:59:14.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 127057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 151049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/ 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 888945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 346977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1408481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 117585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-31T11:59:14.785 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 131601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 181409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 171649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/ 2024-08-31T11:59:14.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 301017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 105857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 885465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 264393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-08-31T11:59:14.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 142481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/ 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1346017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/ 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/ 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/ 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/ 2024-08-31T11:59:14.788 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 644913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/ 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 208177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 82033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/ 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/ 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 110881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-31T11:59:14.789 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/defxx.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/skfp/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 275889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/skfp/skfp.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/ 2024-08-31T11:59:14.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 290697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/ 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 107849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/ 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-gpio.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-08-31T11:59:14.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/ 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-08-31T11:59:14.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 118505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/plip/ 2024-08-31T11:59:14.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/plip/plip.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/ 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/ 2024-08-31T11:59:14.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 136729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/ 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 179329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/ 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 384193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/ 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 175857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ 2024-08-31T11:59:14.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/ 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/ 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 337697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 128353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/ 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 164153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/ 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/ 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-08-31T11:59:14.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pci-stub.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/ 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 177817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia_core.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 133969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/ 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/broadcom/ 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/samsung/ 2024-08-31T11:59:14.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/ 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/ 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/ 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/ 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/ 2024-08-31T11:59:14.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 172313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/ibm_rtl.ko 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/ 2024-08-31T11:59:14.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-08-31T11:59:14.800 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/ 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/88pm860x_battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/88pm860x_charger.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq2415x_charger.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq24190_charger.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq24735-charger.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/cros_charge-control.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/da9030_battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/da9052-battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2760_battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2780_battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2781_battery.ko 2024-08-31T11:59:14.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2782_battery.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/gpio-charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/isp1704_charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/lp8727_charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max14577_charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max17042_battery.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max8903_charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max8925_power.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/pcf50633-charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/sbs-battery.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/test_power.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/tps65090-charger.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm831x_backup.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm831x_power.ko 2024-08-31T11:59:14.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm8350_power.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/ 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/ 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/ 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/ 2024-08-31T11:59:14.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/ 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/ 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/ 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-88pm80x.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-88pm860x.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9052.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9055.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9063.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 82585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-31T11:59:14.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-lp8788.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-31T11:59:14.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t86.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8907.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8925.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8997.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8998.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-palmas.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf50633.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-31T11:59:14.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rc5t583.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-s35390a.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-tps6586x.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-tps65910.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-wm831x.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-wm8350.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-08-31T11:59:14.807 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 164753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/ 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 341105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/ 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 468305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 380857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic94xx/ 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 244049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-08-31T11:59:14.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 135801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 305161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1526289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 298321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 144553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/ 2024-08-31T11:59:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 390817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/ 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 117561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 168361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/ 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 267737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-08-31T11:59:14.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/ 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 191041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fdomain.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/ 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 366737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 251641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/imm.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 327841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/ 2024-08-31T11:59:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 398505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/ 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 380649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 172833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/ 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 274913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/ 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2737441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/ 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-31T11:59:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 388737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 105177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/ 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 833969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/ 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 158857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 96697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/ 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-08-31T11:59:14.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/ 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 444273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 152097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ppa.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/ 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2323537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/ 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 697393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qlogicfas408.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 331577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 219497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 349593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-31T11:59:14.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 121777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 92385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 138265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/ 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 205137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/xen-scsifront.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 172697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-08-31T11:59:14.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 915121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1161521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 149801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/ 2024-08-31T11:59:14.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/ 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-31T11:59:14.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 99417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/moxa.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/mxser.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 134633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-08-31T11:59:14.818 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/ 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/ 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/altera_uart.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/ 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 121249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/rp2.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/sc16is7xx.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/ 2024-08-31T11:59:14.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 689289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/ 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_dmem_genirq.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_mf624.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_netx.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-08-31T11:59:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/ 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/c67x00/ 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/c67x00/c67x00.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 187689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/ 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-08-31T11:59:14.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 107633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/common/ 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/common/ulpi.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc2/ 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/ 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 576329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/ 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/ 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/u_ether.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/u_serial.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-08-31T11:59:14.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 132897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 142801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 99913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/ 2024-08-31T11:59:14.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-08-31T11:59:14.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 200137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/libcomposite.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/ 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/bdc/ 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 182665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/net2272.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/net2280.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-08-31T11:59:14.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 191281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/ 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/bcma-hcd.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/isp116x-hcd.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 104817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-08-31T11:59:14.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811_cs.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/ssb-hcd.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/ 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/cytherm.ko 2024-08-31T11:59:14.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ehset.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/lvstest.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/ 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-08-31T11:59:14.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbtest.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/mon/ 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/mon/usbmon.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/musb/ 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 391209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/musb/musb_hdrc.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/ 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-isp1301.ko 2024-08-31T11:59:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-tahvo.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/f81232.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 188729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-31T11:59:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 152409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 142937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/metro-usb.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-08-31T11:59:14.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 91625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mxuport.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 201257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-31T11:59:14.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 148729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usbserial.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/wishbone-serial.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-31T11:59:14.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 201057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-08-31T11:59:14.864 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/ 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/ 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/ 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 196977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 134401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 93481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/ 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 135241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-08-31T11:59:14.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 110185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/ 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/ 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/aat2870_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp5520_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp8860_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp8870_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/as3711_bl.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/bd6107.ko 2024-08-31T11:59:14.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/da903x_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/da9052_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/gpio_backlight.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/kb3886_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lm3533_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lm3639_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lv5207lp.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/max8925_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/pandora_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/wm831x_bl.ko 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/ 2024-08-31T11:59:14.867 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/matrox_w1.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/w1-gpio.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/ 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-31T11:59:14.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 127601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/acquirewdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/advantechwdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/cpu5wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9052_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9055_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9063_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/dw_wdt.ko 2024-08-31T11:59:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/eurotechwdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/kempld_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/mena21_wdt.ko 2024-08-31T11:59:14.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pc87413_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/retu_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sc1200wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-08-31T11:59:14.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/twl4030_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wafer5823wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wm831x_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wm8350_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/ 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-08-31T11:59:14.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 214065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-scsiback.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 195161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/adfs/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/adfs/adfs.ko 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/ 2024-08-31T11:59:14.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 197849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/afs/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1259073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/afs/kafs.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/autofs/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 127665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/autofs/autofs4.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/bfs/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/bfs/bfs.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 4575041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/ 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 384329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-08-31T11:59:14.874 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1591857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 130593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/configfs/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 137313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/configfs/configfs.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 841817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/efs/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/efs/efs.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/ 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1901633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-08-31T11:59:14.875 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/freevxfs/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/freevxfs/freevxfs.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1488329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 183553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 282177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hpfs/ 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 248625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hpfs/hpfs.ko 2024-08-31T11:59:14.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 93513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 529833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 359969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 646793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/ 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 111585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-31T11:59:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/ 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/ 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 147553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1291361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv2.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 152537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2526953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/ 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/ 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2119673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/ 2024-08-31T11:59:14.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 734385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/ 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ascii.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-08-31T11:59:14.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-08-31T11:59:14.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 144409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 167273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-08-31T11:59:14.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ntfs3/ 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 632217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ntfs3/ntfs3.ko 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ 2024-08-31T11:59:14.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 299761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 547233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 3255305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/omfs/ 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/omfs/omfs.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/ 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 468161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ 2024-08-31T11:59:14.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx4/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx4/qnx4.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx6/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx6/qnx6.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_tree.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_v1.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_v2.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 684489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/ 2024-08-31T11:59:14.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 3333977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 163081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 116065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 309513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 198129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-08-31T11:59:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 5454809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/locking/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/locking/locktorture.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/time/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/time/test_udelay.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc7.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/ 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-08-31T11:59:14.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/interval_tree_test.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/ 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/ 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/memory-notifier-error-inject.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/notifier-error-inject.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/percpu_test.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/pm-notifier-error-inject.ko 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/ 2024-08-31T11:59:14.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 151073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-08-31T11:59:14.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/rbtree_test.ko 2024-08-31T11:59:14.888 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/ 2024-08-31T11:59:14.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-31T11:59:14.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test-kstrtox.ko 2024-08-31T11:59:14.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 4912673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_bpf.ko 2024-08-31T11:59:14.921 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_firmware.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_module.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/xz/ 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/xz/xz_dec_test.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/ 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/ 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-08-31T11:59:14.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/ 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/ 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/ 2024-08-31T11:59:14.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 234745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/ 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 875441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/ 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1026825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-31T11:59:14.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-31T11:59:14.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/ 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1229873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/ 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 154121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/ 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 239393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-08-31T11:59:14.926 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/ 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 498249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/hsr/ 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 137945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/hsr/hsr.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 356385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ 2024-08-31T11:59:14.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-31T11:59:14.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ip_tables.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-31T11:59:14.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-08-31T11:59:14.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-08-31T11:59:14.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_gre.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 117649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/mip6.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-31T11:59:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-31T11:59:14.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/ 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/ 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 155593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-08-31T11:59:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/lapb/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/lapb/lapb.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 333641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc2.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 388577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ 2024-08-31T11:59:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 144881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 126777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 126577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 137937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 133785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 139177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 138369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 136281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-31T11:59:14.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 140001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 532393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-31T11:59:14.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 485769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 134177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 140921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-31T11:59:14.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-31T11:59:14.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 813705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-31T11:59:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_osf.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_synproxy.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tproxy.ko 2024-08-31T11:59:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 104257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/x_tables.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-08-31T11:59:14.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-08-31T11:59:14.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-08-31T11:59:14.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-08-31T11:59:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpudp.ko 2024-08-31T11:59:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/ 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/ 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/ 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 485961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/ 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/ 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 141545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/phonet.ko 2024-08-31T11:59:14.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/pn_pep.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/ 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 314473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 202161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rxrpc/ 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1024009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rxrpc/rxrpc.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/ 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-08-31T11:59:14.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_cgroup.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-08-31T11:59:14.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq_codel.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-08-31T11:59:14.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/ 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1184689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-08-31T11:59:14.951 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 426969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1895553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 925089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1122601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/ 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-31T11:59:14.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/x25/ 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 165529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/x25/x25.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/ 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_algo.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 135873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_user.ko 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 649700 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 633853 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7850 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23959 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10056 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-08-31T11:59:14.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74053 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 147543 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 233297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 210 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72756 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 879 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 261535 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 316586 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/ 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/ 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/doc/ 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 174 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/changelog.Debian.gz 2024-08-31T11:59:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 691 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/copyright 2024-08-31T11:59:14.959 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.959 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.960 DEBUG:teuthology.orchestra.run.smithi164:> egrep '(submenu|menuentry.*6.11.0-rc5-g8ad8b8b16098).*{' /boot/grub/grub.cfg 2024-08-31T11:59:14.970 INFO:teuthology.orchestra.run.smithi164.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T11:59:14.971 INFO:teuthology.orchestra.run.smithi164.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g8ad8b8b16098-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T11:59:14.971 INFO:teuthology.orchestra.run.smithi164.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g8ad8b8b16098-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T11:59:14.971 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-08-31T11:59:14.971 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:14.971 DEBUG:teuthology.orchestra.run.smithi164:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-08-31T11:59:15.015 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-08-31T11:59:15.470 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2024-08-31T11:59:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T11:59:15.500 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-08-31T11:59:15.762 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:15.768 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T11:59:16.106 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T11:59:16.110 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T11:59:16.153 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T11:59:16.158 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T11:59:16.312 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T11:59:16.312 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T11:59:16.312 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T11:59:16.322 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-08-31T11:59:47.459 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-31T11:59:47.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T11:59:47.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:00:05.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-08-31T12:00:14.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:00:14.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:00:18.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-08-31T12:00:30.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:00:30.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:00:48.449 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-08-31T12:01:03.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:01:03.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:01:03.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-08-31T12:01:21.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:01:21.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:01:21.765 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-08-31T12:01:22.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:01:22.393 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-08-31T12:01:22.393 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-08-31T12:01:22.442 INFO:teuthology.orchestra.run.smithi164.stdout:6.11.0-rc5-g8ad8b8b16098 2024-08-31T12:01:22.442 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-08-31T12:01:22.443 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T12:01:22.443 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-31T12:01:23.443 DEBUG:teuthology.parallel:result is None 2024-08-31T12:01:23.443 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T12:01:23.451 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T12:01:23.451 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T12:01:23.454 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T12:01:23.460 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T12:01:23.467 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T12:01:23.473 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T12:01:23.473 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T12:01:23.506 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T12:01:23.532 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T12:01:23.539 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T12:01:23.539 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T12:01:23.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:01:23.572 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T12:01:23.575 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T12:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:01:23.651 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:01:23.654 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:01:23.673 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:01:23.676 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T12:01:23.682 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T12:01:23.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T12:01:23.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T12:01:23.712 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T12:01:23.721 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T12:01:23.721 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T12:01:23.750 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T12:01:23.764 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:01:23.807 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:01:23.859 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:01:23.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T12:01:23.930 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:01:23.936 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:01:23.984 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:01:23.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T12:01:24.048 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-08-31T12:01:24.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-08-31T12:01:24.171 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T12:01:24.181 INFO:teuthology.task.internal:Starting timer... 2024-08-31T12:01:24.181 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T12:01:24.191 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T12:01:24.199 DEBUG:teuthology.task.selinux:Excluding smithi164: OS 'ubuntu' does not support SELinux 2024-08-31T12:01:24.199 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2024-08-31T12:01:24.199 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T12:01:24.199 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-31T12:01:24.199 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T12:01:24.199 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T12:01:24.207 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T12:01:24.217 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T12:01:28.813 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi164.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T12:09:36.036 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-08-31T12:09:36.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:09:36.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:09:36.121 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-08-31T12:09:36.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-08-31T12:09:36.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-08-31T12:09:36.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:09:36.329 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-08-31T12:09:36.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-08-31T12:09:36.433 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T12:09:36.473 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T12:09:36.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T12:09:36.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:09:36.477 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T12:09:36.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:09:36.507 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T12:09:36.507 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Command line: ntpd -gq 2024-08-31T12:09:36.507 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: ---------------------------------------------------- 2024-08-31T12:09:36.507 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T12:09:36.508 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T12:09:36.508 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: corporation. Support and training for ntp-4 are 2024-08-31T12:09:36.508 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: available at https://www.nwtime.org/support 2024-08-31T12:09:36.508 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: ---------------------------------------------------- 2024-08-31T12:09:36.509 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: proto: precision = 0.063 usec (-24) 2024-08-31T12:09:36.509 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: basedate set to 2022-02-04 2024-08-31T12:09:36.509 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: gps base set to 2022-02-06 (week 2196) 2024-08-31T12:09:36.509 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T12:09:36.510 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T12:09:36.510 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T12:09:36.510 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen normally on 4 lo [::1]:123 2024-08-31T12:09:36.511 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2024-08-31T12:09:36.512 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:36 ntpd[18862]: Listening on routing socket on fd #22 for interface updates 2024-08-31T12:09:36.512 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T12:09:36.512 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Command line: ntpd -gq 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: ---------------------------------------------------- 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: corporation. Support and training for ntp-4 are 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: available at https://www.nwtime.org/support 2024-08-31T12:09:36.513 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: ---------------------------------------------------- 2024-08-31T12:09:36.514 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: proto: precision = 0.042 usec (-24) 2024-08-31T12:09:36.514 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: basedate set to 2022-02-04 2024-08-31T12:09:36.514 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: gps base set to 2022-02-06 (week 2196) 2024-08-31T12:09:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T12:09:36.515 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T12:09:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T12:09:36.516 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T12:09:36.516 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen normally on 3 enp3s0f1 172.21.15.164:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen normally on 4 lo [::1]:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:73f3%5]:123 2024-08-31T12:09:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:36 ntpd[18415]: Listening on routing socket on fd #22 for interface updates 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:37.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:37 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:37 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:38.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:38.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:38.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:38.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:38.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:38.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:38 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:39.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:39 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:39.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:39.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:39 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:40.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:40 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:40.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:40 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:41 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:41.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:41.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:41 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:42.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:42 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:42.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:42.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:42.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:42.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:42.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:42.515 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:42 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:43.508 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:43.509 INFO:teuthology.orchestra.run.smithi184.stdout:31 Aug 12:09:43 ntpd[18862]: ntpd: time slew -0.003269 s 2024-08-31T12:09:43.509 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew -0.003269s 2024-08-31T12:09:43.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T12:09:43.509 INFO:teuthology.orchestra.run.smithi184.stderr:31 Aug 12:09:43 ntpd[18862]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T12:09:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T12:09:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T12:09:43.514 INFO:teuthology.orchestra.run.smithi164.stdout:31 Aug 12:09:43 ntpd[18415]: ntpd: time slew -0.000069 s 2024-08-31T12:09:43.514 INFO:teuthology.orchestra.run.smithi164.stdout:ntpd: time slew -0.000069s 2024-08-31T12:09:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T12:09:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:31 Aug 12:09:43 ntpd[18415]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T12:09:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T12:09:43.607 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-08-31T12:09:43.607 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.608 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T12:09:43.613 INFO:teuthology.run_tasks:Running task install... 2024-08-31T12:09:43.621 DEBUG:teuthology.task.install:project ceph 2024-08-31T12:09:43.621 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T12:09:43.621 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T12:09:43.621 INFO:teuthology.task.install:Using flavor: default 2024-08-31T12:09:43.627 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T12:09:43.627 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T12:09:43.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-key list | grep Ceph 2024-08-31T12:09:43.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2024-08-31T12:09:43.710 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T12:09:43.740 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T12:09:43.740 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T12:09:43.740 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-31T12:09:43.741 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-31T12:09:43.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:09:43.749 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T12:09:43.884 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default/ 2024-08-31T12:09:43.884 INFO:teuthology.task.install.deb:Package version is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:09:43.990 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T12:09:43.990 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T12:09:43.991 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-31T12:09:43.992 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-31T12:09:43.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:09:43.997 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:09:43.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T12:09:44.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-08-31T12:09:44.136 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default/ 2024-08-31T12:09:44.136 INFO:teuthology.task.install.deb:Package version is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:09:44.238 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T12:09:44.250 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:09:44.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T12:09:44.260 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-31T12:09:44.270 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-08-31T12:09:44.284 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T12:09:44.305 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T12:09:44.305 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-08-31T12:09:44.315 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T12:09:44.337 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-08-31T12:09:44.378 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T12:09:44.459 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T12:09:44.505 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T12:09:44.526 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-31T12:09:44.548 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T12:09:44.569 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-08-31T12:09:44.590 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T12:09:44.591 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T12:09:44.612 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-08-31T12:09:44.653 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T12:09:44.664 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 29.2 kB in 0s (61.4 kB/s) 2024-08-31T12:09:44.734 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T12:09:45.185 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 29.2 kB in 1s (42.5 kB/s) 2024-08-31T12:09:45.670 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-08-31T12:09:45.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4560-gd19e6118-1jammy cephadm=19.3.0-4560-gd19e6118-1jammy ceph-mds=19.3.0-4560-gd19e6118-1jammy ceph-mgr=19.3.0-4560-gd19e6118-1jammy ceph-common=19.3.0-4560-gd19e6118-1jammy ceph-fuse=19.3.0-4560-gd19e6118-1jammy ceph-test=19.3.0-4560-gd19e6118-1jammy ceph-volume=19.3.0-4560-gd19e6118-1jammy radosgw=19.3.0-4560-gd19e6118-1jammy python3-rados=19.3.0-4560-gd19e6118-1jammy python3-rgw=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy python3-rbd=19.3.0-4560-gd19e6118-1jammy libcephfs2=19.3.0-4560-gd19e6118-1jammy libcephfs-dev=19.3.0-4560-gd19e6118-1jammy librados2=19.3.0-4560-gd19e6118-1jammy librbd1=19.3.0-4560-gd19e6118-1jammy rbd-fuse=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy cephfs-shell=19.3.0-4560-gd19e6118-1jammy cephfs-top=19.3.0-4560-gd19e6118-1jammy cephfs-mirror=19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:09:45.740 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-08-31T12:09:45.925 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-08-31T12:09:45.925 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-08-31T12:09:46.111 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T12:09:46.111 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T12:09:46.111 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T12:09:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T12:09:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T12:09:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: python2.7-minimal 2024-08-31T12:09:46.112 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T12:09:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-31T12:09:46.116 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-31T12:09:46.117 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-31T12:09:46.118 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-31T12:09:46.118 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-31T12:09:46.118 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-08-31T12:09:46.118 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T12:09:46.118 INFO:teuthology.orchestra.run.smithi184.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2024-08-31T12:09:46.119 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2024-08-31T12:09:46.220 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-08-31T12:09:46.221 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-08-31T12:09:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T12:09:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T12:09:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-31T12:09:46.222 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T12:09:46.223 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-31T12:09:46.224 INFO:teuthology.orchestra.run.smithi184.stdout: socat unzip xmlstarlet zip 2024-08-31T12:09:46.234 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4560-gd19e6118-1jammy cephadm=19.3.0-4560-gd19e6118-1jammy ceph-mds=19.3.0-4560-gd19e6118-1jammy ceph-mgr=19.3.0-4560-gd19e6118-1jammy ceph-common=19.3.0-4560-gd19e6118-1jammy ceph-fuse=19.3.0-4560-gd19e6118-1jammy ceph-test=19.3.0-4560-gd19e6118-1jammy ceph-volume=19.3.0-4560-gd19e6118-1jammy radosgw=19.3.0-4560-gd19e6118-1jammy python3-rados=19.3.0-4560-gd19e6118-1jammy python3-rgw=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy python3-rbd=19.3.0-4560-gd19e6118-1jammy libcephfs2=19.3.0-4560-gd19e6118-1jammy libcephfs-dev=19.3.0-4560-gd19e6118-1jammy librados2=19.3.0-4560-gd19e6118-1jammy librbd1=19.3.0-4560-gd19e6118-1jammy rbd-fuse=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy cephfs-shell=19.3.0-4560-gd19e6118-1jammy cephfs-top=19.3.0-4560-gd19e6118-1jammy cephfs-mirror=19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:09:46.311 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-08-31T12:09:46.369 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-08-31T12:09:46.369 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 247 MB of archives. 2024-08-31T12:09:46.369 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 1,021 MB of additional disk space will be used. 2024-08-31T12:09:46.370 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4560-gd19e6118-1jammy [3,589 kB] 2024-08-31T12:09:46.411 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-31T12:09:46.494 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T12:09:46.496 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-08-31T12:09:46.497 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-08-31T12:09:46.540 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-31T12:09:46.561 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4560-gd19e6118-1jammy [3,356 kB] 2024-08-31T12:09:46.608 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4560-gd19e6118-1jammy [734 kB] 2024-08-31T12:09:46.619 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4560-gd19e6118-1jammy [356 kB] 2024-08-31T12:09:46.625 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4560-gd19e6118-1jammy [32.8 kB] 2024-08-31T12:09:46.626 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4560-gd19e6118-1jammy [180 kB] 2024-08-31T12:09:46.628 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4560-gd19e6118-1jammy [70.2 kB] 2024-08-31T12:09:46.629 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4560-gd19e6118-1jammy [338 kB] 2024-08-31T12:09:46.635 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4560-gd19e6118-1jammy [8,856 kB] 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T12:09:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T12:09:46.692 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T12:09:46.693 INFO:teuthology.orchestra.run.smithi164.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T12:09:46.693 INFO:teuthology.orchestra.run.smithi164.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T12:09:46.693 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T12:09:46.693 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T12:09:46.693 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-31T12:09:46.694 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-31T12:09:46.695 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-31T12:09:46.696 INFO:teuthology.orchestra.run.smithi164.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-31T12:09:46.696 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-08-31T12:09:46.696 INFO:teuthology.orchestra.run.smithi164.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2024-08-31T12:09:46.697 INFO:teuthology.orchestra.run.smithi164.stdout: btrfs-tools 2024-08-31T12:09:46.735 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T12:09:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4560-gd19e6118-1jammy [112 kB] 2024-08-31T12:09:46.783 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4560-gd19e6118-1jammy [477 kB] 2024-08-31T12:09:46.790 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4560-gd19e6118-1jammy [29.1 MB] 2024-08-31T12:09:46.827 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T12:09:46.840 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T12:09:46.846 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-08-31T12:09:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T12:09:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T12:09:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-31T12:09:46.846 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-31T12:09:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T12:09:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T12:09:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T12:09:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-31T12:09:46.850 INFO:teuthology.orchestra.run.smithi164.stdout: socat unzip xmlstarlet zip 2024-08-31T12:09:46.894 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T12:09:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-08-31T12:09:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 247 MB of archives. 2024-08-31T12:09:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 1,021 MB of additional disk space will be used. 2024-08-31T12:09:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-31T12:09:47.063 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T12:09:47.072 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T12:09:47.117 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T12:09:47.127 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T12:09:47.130 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T12:09:47.133 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T12:09:47.136 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4560-gd19e6118-1jammy [3,589 kB] 2024-08-31T12:09:47.160 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T12:09:47.166 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T12:09:47.172 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T12:09:47.173 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-31T12:09:47.175 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T12:09:47.176 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T12:09:47.229 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T12:09:47.236 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T12:09:47.237 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T12:09:47.239 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T12:09:47.310 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T12:09:47.327 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T12:09:47.328 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T12:09:47.359 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T12:09:47.360 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T12:09:47.361 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T12:09:47.370 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T12:09:47.415 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4560-gd19e6118-1jammy [5,011 kB] 2024-08-31T12:09:47.415 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T12:09:47.416 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T12:09:47.421 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T12:09:47.423 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T12:09:47.462 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T12:09:47.473 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T12:09:47.474 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T12:09:47.475 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T12:09:47.476 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T12:09:47.477 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T12:09:47.483 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4560-gd19e6118-1jammy [251 kB] 2024-08-31T12:09:47.486 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4560-gd19e6118-1jammy [126 kB] 2024-08-31T12:09:47.488 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4560-gd19e6118-1jammy [1,551 kB] 2024-08-31T12:09:47.501 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4560-gd19e6118-1jammy [6,139 kB] 2024-08-31T12:09:47.524 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T12:09:47.555 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T12:09:47.557 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T12:09:47.559 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T12:09:47.560 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T12:09:47.571 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T12:09:47.572 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T12:09:47.584 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4560-gd19e6118-1jammy [3,356 kB] 2024-08-31T12:09:47.609 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4560-gd19e6118-1jammy [22.8 MB] 2024-08-31T12:09:47.637 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T12:09:47.639 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T12:09:47.641 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T12:09:47.645 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T12:09:47.703 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T12:09:47.712 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T12:09:47.719 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T12:09:47.722 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T12:09:47.724 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T12:09:47.729 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T12:09:47.730 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T12:09:47.732 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T12:09:47.739 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T12:09:47.748 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T12:09:47.748 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T12:09:47.766 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T12:09:47.770 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T12:09:47.774 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T12:09:47.777 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T12:09:47.785 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T12:09:47.800 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T12:09:47.859 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T12:09:47.865 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T12:09:47.866 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T12:09:47.866 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T12:09:47.866 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T12:09:47.867 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T12:09:47.867 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T12:09:47.867 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T12:09:47.868 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T12:09:47.922 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T12:09:47.924 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T12:09:47.926 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T12:09:47.927 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T12:09:47.942 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4560-gd19e6118-1jammy [734 kB] 2024-08-31T12:09:47.949 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T12:09:47.949 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T12:09:47.949 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T12:09:47.952 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T12:09:47.952 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T12:09:47.964 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T12:09:47.995 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T12:09:48.002 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T12:09:48.002 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T12:09:48.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T12:09:48.031 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T12:09:48.031 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T12:09:48.032 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T12:09:48.032 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T12:09:48.054 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4560-gd19e6118-1jammy [356 kB] 2024-08-31T12:09:48.060 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4560-gd19e6118-1jammy [32.8 kB] 2024-08-31T12:09:48.061 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4560-gd19e6118-1jammy [180 kB] 2024-08-31T12:09:48.064 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4560-gd19e6118-1jammy [70.2 kB] 2024-08-31T12:09:48.104 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4560-gd19e6118-1jammy [338 kB] 2024-08-31T12:09:48.110 INFO:teuthology.orchestra.run.smithi164.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4560-gd19e6118-1jammy [8,856 kB] 2024-08-31T12:09:48.111 INFO:teuthology.orchestra.run.smithi164.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T12:09:48.112 INFO:teuthology.orchestra.run.smithi164.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T12:09:48.113 INFO:teuthology.orchestra.run.smithi164.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T12:09:48.117 INFO:teuthology.orchestra.run.smithi164.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T12:09:48.118 INFO:teuthology.orchestra.run.smithi164.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T12:09:48.127 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T12:09:48.127 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T12:09:48.128 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4560-gd19e6118-1jammy [14.0 kB] 2024-08-31T12:09:48.128 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4560-gd19e6118-1jammy [865 kB] 2024-08-31T12:09:48.129 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T12:09:48.185 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4560-gd19e6118-1jammy [2,381 kB] 2024-08-31T12:09:48.185 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T12:09:48.186 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T12:09:48.187 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T12:09:48.188 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T12:09:48.190 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T12:09:48.193 INFO:teuthology.orchestra.run.smithi164.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T12:09:48.193 INFO:teuthology.orchestra.run.smithi164.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T12:09:48.195 INFO:teuthology.orchestra.run.smithi164.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T12:09:48.196 INFO:teuthology.orchestra.run.smithi164.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T12:09:48.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T12:09:48.197 INFO:teuthology.orchestra.run.smithi164.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T12:09:48.210 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T12:09:48.219 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4560-gd19e6118-1jammy [810 kB] 2024-08-31T12:09:48.231 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4560-gd19e6118-1jammy [159 kB] 2024-08-31T12:09:48.233 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4560-gd19e6118-1jammy [61.3 MB] 2024-08-31T12:09:48.275 INFO:teuthology.orchestra.run.smithi164.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T12:09:48.275 INFO:teuthology.orchestra.run.smithi164.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T12:09:48.277 INFO:teuthology.orchestra.run.smithi164.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T12:09:48.278 INFO:teuthology.orchestra.run.smithi164.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T12:09:48.279 INFO:teuthology.orchestra.run.smithi164.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T12:09:48.283 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T12:09:48.284 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T12:09:48.293 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T12:09:48.300 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-31T12:09:48.301 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T12:09:48.304 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T12:09:48.305 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T12:09:48.317 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T12:09:48.318 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T12:09:48.356 INFO:teuthology.orchestra.run.smithi164.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T12:09:48.373 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T12:09:48.373 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T12:09:48.454 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T12:09:48.455 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T12:09:48.459 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T12:09:48.461 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T12:09:48.465 INFO:teuthology.orchestra.run.smithi164.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T12:09:48.466 INFO:teuthology.orchestra.run.smithi164.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T12:09:48.467 INFO:teuthology.orchestra.run.smithi164.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T12:09:48.468 INFO:teuthology.orchestra.run.smithi164.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T12:09:48.469 INFO:teuthology.orchestra.run.smithi164.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T12:09:48.479 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T12:09:48.480 INFO:teuthology.orchestra.run.smithi184.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T12:09:48.481 INFO:teuthology.orchestra.run.smithi184.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T12:09:48.486 INFO:teuthology.orchestra.run.smithi184.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T12:09:48.507 INFO:teuthology.orchestra.run.smithi164.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4560-gd19e6118-1jammy [112 kB] 2024-08-31T12:09:48.508 INFO:teuthology.orchestra.run.smithi164.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4560-gd19e6118-1jammy [477 kB] 2024-08-31T12:09:48.536 INFO:teuthology.orchestra.run.smithi184.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T12:09:48.539 INFO:teuthology.orchestra.run.smithi164.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T12:09:48.542 INFO:teuthology.orchestra.run.smithi164.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T12:09:48.542 INFO:teuthology.orchestra.run.smithi164.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T12:09:48.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4560-gd19e6118-1jammy [29.1 MB] 2024-08-31T12:09:48.613 INFO:teuthology.orchestra.run.smithi164.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T12:09:48.613 INFO:teuthology.orchestra.run.smithi164.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T12:09:48.630 INFO:teuthology.orchestra.run.smithi164.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T12:09:48.631 INFO:teuthology.orchestra.run.smithi164.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T12:09:48.631 INFO:teuthology.orchestra.run.smithi164.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T12:09:48.632 INFO:teuthology.orchestra.run.smithi164.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T12:09:48.632 INFO:teuthology.orchestra.run.smithi164.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T12:09:48.633 INFO:teuthology.orchestra.run.smithi164.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T12:09:48.637 INFO:teuthology.orchestra.run.smithi164.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T12:09:48.712 INFO:teuthology.orchestra.run.smithi164.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T12:09:48.713 INFO:teuthology.orchestra.run.smithi164.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T12:09:48.714 INFO:teuthology.orchestra.run.smithi164.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T12:09:48.793 INFO:teuthology.orchestra.run.smithi164.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T12:09:48.796 INFO:teuthology.orchestra.run.smithi164.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-31T12:09:48.796 INFO:teuthology.orchestra.run.smithi164.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T12:09:48.797 INFO:teuthology.orchestra.run.smithi164.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T12:09:48.798 INFO:teuthology.orchestra.run.smithi164.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T12:09:48.803 INFO:teuthology.orchestra.run.smithi164.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T12:09:48.803 INFO:teuthology.orchestra.run.smithi164.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T12:09:48.875 INFO:teuthology.orchestra.run.smithi164.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T12:09:48.876 INFO:teuthology.orchestra.run.smithi164.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T12:09:48.876 INFO:teuthology.orchestra.run.smithi164.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T12:09:48.956 INFO:teuthology.orchestra.run.smithi164.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T12:09:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T12:09:48.959 INFO:teuthology.orchestra.run.smithi164.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T12:09:48.966 INFO:teuthology.orchestra.run.smithi164.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T12:09:48.966 INFO:teuthology.orchestra.run.smithi164.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T12:09:48.966 INFO:teuthology.orchestra.run.smithi164.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T12:09:48.969 INFO:teuthology.orchestra.run.smithi164.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T12:09:49.038 INFO:teuthology.orchestra.run.smithi164.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T12:09:49.827 INFO:teuthology.orchestra.run.smithi164.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4560-gd19e6118-1jammy [5,011 kB] 2024-08-31T12:09:49.923 INFO:teuthology.orchestra.run.smithi164.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4560-gd19e6118-1jammy [251 kB] 2024-08-31T12:09:49.926 INFO:teuthology.orchestra.run.smithi164.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4560-gd19e6118-1jammy [126 kB] 2024-08-31T12:09:49.928 INFO:teuthology.orchestra.run.smithi164.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4560-gd19e6118-1jammy [1,551 kB] 2024-08-31T12:09:49.954 INFO:teuthology.orchestra.run.smithi164.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4560-gd19e6118-1jammy [6,139 kB] 2024-08-31T12:09:50.027 INFO:teuthology.orchestra.run.smithi184.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4560-gd19e6118-1jammy [8,625 kB] 2024-08-31T12:09:50.059 INFO:teuthology.orchestra.run.smithi164.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4560-gd19e6118-1jammy [22.8 MB] 2024-08-31T12:09:50.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4560-gd19e6118-1jammy [14.2 kB] 2024-08-31T12:09:50.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4560-gd19e6118-1jammy [48.9 MB] 2024-08-31T12:09:50.908 INFO:teuthology.orchestra.run.smithi164.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4560-gd19e6118-1jammy [14.0 kB] 2024-08-31T12:09:50.908 INFO:teuthology.orchestra.run.smithi164.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4560-gd19e6118-1jammy [865 kB] 2024-08-31T12:09:50.928 INFO:teuthology.orchestra.run.smithi164.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4560-gd19e6118-1jammy [2,381 kB] 2024-08-31T12:09:51.022 INFO:teuthology.orchestra.run.smithi164.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4560-gd19e6118-1jammy [810 kB] 2024-08-31T12:09:51.056 INFO:teuthology.orchestra.run.smithi164.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4560-gd19e6118-1jammy [159 kB] 2024-08-31T12:09:51.058 INFO:teuthology.orchestra.run.smithi164.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4560-gd19e6118-1jammy [61.3 MB] 2024-08-31T12:09:51.858 INFO:teuthology.orchestra.run.smithi184.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4560-gd19e6118-1jammy [130 kB] 2024-08-31T12:09:51.860 INFO:teuthology.orchestra.run.smithi184.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4560-gd19e6118-1jammy [237 kB] 2024-08-31T12:09:51.865 INFO:teuthology.orchestra.run.smithi184.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4560-gd19e6118-1jammy [33.9 kB] 2024-08-31T12:09:51.866 INFO:teuthology.orchestra.run.smithi184.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4560-gd19e6118-1jammy [23.4 kB] 2024-08-31T12:09:51.867 INFO:teuthology.orchestra.run.smithi184.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4560-gd19e6118-1jammy [39.0 kB] 2024-08-31T12:09:51.868 INFO:teuthology.orchestra.run.smithi184.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4560-gd19e6118-1jammy [17.6 MB] 2024-08-31T12:09:52.351 INFO:teuthology.orchestra.run.smithi184.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4560-gd19e6118-1jammy [92.9 kB] 2024-08-31T12:09:52.696 INFO:teuthology.orchestra.run.smithi164.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4560-gd19e6118-1jammy [8,625 kB] 2024-08-31T12:09:52.824 INFO:teuthology.orchestra.run.smithi164.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4560-gd19e6118-1jammy [14.2 kB] 2024-08-31T12:09:52.825 INFO:teuthology.orchestra.run.smithi164.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4560-gd19e6118-1jammy [48.9 MB] 2024-08-31T12:09:52.970 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 247 MB in 6s (40.4 MB/s) 2024-08-31T12:09:53.084 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-31T12:09:53.146 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-08-31T12:09:53.150 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-31T12:09:53.199 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-31T12:09:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T12:09:53.473 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T12:09:53.510 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T12:09:53.639 INFO:teuthology.orchestra.run.smithi164.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4560-gd19e6118-1jammy [130 kB] 2024-08-31T12:09:53.640 INFO:teuthology.orchestra.run.smithi164.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4560-gd19e6118-1jammy [237 kB] 2024-08-31T12:09:53.642 INFO:teuthology.orchestra.run.smithi164.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4560-gd19e6118-1jammy [33.9 kB] 2024-08-31T12:09:53.643 INFO:teuthology.orchestra.run.smithi164.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4560-gd19e6118-1jammy [23.4 kB] 2024-08-31T12:09:53.643 INFO:teuthology.orchestra.run.smithi164.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4560-gd19e6118-1jammy [39.0 kB] 2024-08-31T12:09:53.644 INFO:teuthology.orchestra.run.smithi164.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4560-gd19e6118-1jammy [17.6 MB] 2024-08-31T12:09:53.855 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cmd2. 2024-08-31T12:09:53.875 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-31T12:09:53.913 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-31T12:09:53.925 INFO:teuthology.orchestra.run.smithi164.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4560-gd19e6118-1jammy [92.9 kB] 2024-08-31T12:09:54.249 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T12:09:54.270 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T12:09:54.333 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T12:09:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 247 MB in 7s (35.0 MB/s) 2024-08-31T12:09:54.636 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T12:09:54.657 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T12:09:54.686 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T12:09:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-31T12:09:54.801 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-08-31T12:09:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-31T12:09:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-31T12:09:55.064 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T12:09:55.085 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T12:09:55.123 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T12:09:55.128 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T12:09:55.142 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T12:09:55.179 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T12:09:55.482 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cmd2. 2024-08-31T12:09:55.495 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-31T12:09:55.540 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-31T12:09:55.551 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T12:09:55.572 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:55.642 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:55.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T12:09:55.882 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T12:09:55.951 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T12:09:55.988 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T12:09:56.009 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:56.046 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:56.204 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T12:09:56.218 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T12:09:56.263 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T12:09:56.433 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T12:09:56.453 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:56.624 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T12:09:56.638 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T12:09:56.682 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T12:09:56.749 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:57.102 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T12:09:57.123 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T12:09:57.135 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T12:09:57.149 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:57.152 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T12:09:57.201 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:57.497 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librados2. 2024-08-31T12:09:57.518 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-librados2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:57.555 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:57.597 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T12:09:57.611 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:57.655 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:58.017 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T12:09:58.031 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T12:09:58.066 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librbd1. 2024-08-31T12:09:58.075 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:09:58.086 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-librbd1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:58.153 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:58.411 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T12:09:58.426 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T12:09:58.470 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T12:09:58.619 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T12:09:58.640 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:58.703 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:58.789 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librados2. 2024-08-31T12:09:58.804 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../010-librados2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:58.839 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:58.997 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2024-08-31T12:09:59.009 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:59.047 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:59.400 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T12:09:59.420 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:59.484 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librbd1. 2024-08-31T12:09:59.499 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../011-librbd1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:59.542 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:59.669 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T12:09:59.680 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:09:59.710 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:09:59.995 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T12:10:00.009 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:00.053 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:00.063 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T12:10:00.084 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:00.121 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:00.330 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rados. 2024-08-31T12:10:00.344 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:00.388 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:00.458 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T12:10:00.479 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T12:10:00.533 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T12:10:00.708 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T12:10:00.722 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:00.766 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:00.785 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T12:10:00.797 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:00.836 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:01.002 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T12:10:01.016 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:01.061 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:01.180 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T12:10:01.201 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T12:10:01.230 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T12:10:01.388 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T12:10:01.403 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:01.446 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:01.533 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T12:10:01.547 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T12:10:01.609 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T12:10:01.816 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T12:10:01.831 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T12:10:01.866 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T12:10:01.936 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T12:10:01.956 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T12:10:01.994 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T12:10:02.094 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T12:10:02.109 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:02.151 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:02.366 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua5.1. 2024-08-31T12:10:02.385 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T12:10:02.423 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T12:10:02.504 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T12:10:02.519 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T12:10:02.562 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T12:10:02.743 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-any. 2024-08-31T12:10:02.763 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-31T12:10:02.801 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T12:10:02.854 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T12:10:02.866 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T12:10:02.915 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T12:10:03.078 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package zip. 2024-08-31T12:10:03.099 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-31T12:10:03.137 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T12:10:03.201 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T12:10:03.216 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T12:10:03.251 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T12:10:03.473 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package unzip. 2024-08-31T12:10:03.494 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T12:10:03.556 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T12:10:03.579 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua5.1. 2024-08-31T12:10:03.594 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T12:10:03.638 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T12:10:03.927 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package luarocks. 2024-08-31T12:10:03.948 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T12:10:03.966 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-any. 2024-08-31T12:10:03.981 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-31T12:10:03.985 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T12:10:04.024 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T12:10:04.302 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package zip. 2024-08-31T12:10:04.317 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-31T12:10:04.352 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T12:10:04.460 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2024-08-31T12:10:04.481 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-librgw2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:04.527 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:04.638 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package unzip. 2024-08-31T12:10:04.653 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T12:10:04.688 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T12:10:05.108 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package luarocks. 2024-08-31T12:10:05.124 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T12:10:05.167 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T12:10:05.279 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T12:10:05.300 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:05.362 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:05.591 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librgw2. 2024-08-31T12:10:05.605 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../027-librgw2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:05.649 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:05.765 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T12:10:05.786 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T12:10:05.832 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T12:10:06.235 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T12:10:06.256 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:06.285 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T12:10:06.300 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:06.302 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:06.343 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T12:10:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T12:10:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T12:10:06.788 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2024-08-31T12:10:06.809 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:06.846 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:07.090 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T12:10:07.105 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:07.140 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:07.585 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-common. 2024-08-31T12:10:07.600 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:07.643 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:08.771 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2024-08-31T12:10:08.791 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:08.838 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:09.023 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-base. 2024-08-31T12:10:09.038 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:09.091 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:09.475 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T12:10:09.496 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T12:10:09.533 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T12:10:09.828 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T12:10:09.837 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T12:10:09.842 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T12:10:09.857 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T12:10:09.886 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T12:10:09.894 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T12:10:10.214 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T12:10:10.228 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T12:10:10.256 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T12:10:10.272 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T12:10:10.277 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T12:10:10.314 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T12:10:10.617 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T12:10:10.625 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T12:10:10.638 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T12:10:10.640 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T12:10:10.675 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T12:10:10.683 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T12:10:10.944 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T12:10:10.959 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T12:10:10.994 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T12:10:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T12:10:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T12:10:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T12:10:11.314 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T12:10:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T12:10:11.331 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T12:10:11.352 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T12:10:11.372 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T12:10:11.389 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T12:10:11.708 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T12:10:11.717 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-portend. 2024-08-31T12:10:11.723 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T12:10:11.738 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-31T12:10:11.767 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T12:10:11.784 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T12:10:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-portend. 2024-08-31T12:10:12.053 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T12:10:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-31T12:10:12.074 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T12:10:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T12:10:12.103 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T12:10:12.389 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T12:10:12.404 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T12:10:12.447 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T12:10:12.532 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T12:10:12.552 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T12:10:12.590 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T12:10:12.783 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T12:10:12.798 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T12:10:12.841 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T12:10:12.952 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T12:10:12.973 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T12:10:13.010 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T12:10:13.178 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T12:10:13.193 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T12:10:13.245 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T12:10:13.346 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T12:10:13.368 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T12:10:13.405 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T12:10:13.589 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T12:10:13.604 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T12:10:13.647 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T12:10:13.707 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T12:10:13.729 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T12:10:13.766 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T12:10:13.976 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T12:10:13.991 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T12:10:14.034 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T12:10:14.119 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2024-08-31T12:10:14.140 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T12:10:14.177 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T12:10:14.295 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-mako. 2024-08-31T12:10:14.309 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T12:10:14.345 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T12:10:14.539 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T12:10:14.560 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T12:10:14.597 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T12:10:14.665 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T12:10:14.679 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T12:10:14.714 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T12:10:14.900 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T12:10:14.921 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T12:10:14.958 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T12:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T12:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T12:10:15.167 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T12:10:15.253 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2024-08-31T12:10:15.273 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T12:10:15.303 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T12:10:15.511 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webob. 2024-08-31T12:10:15.527 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T12:10:15.570 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T12:10:15.597 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T12:10:15.618 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T12:10:15.650 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T12:10:15.914 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T12:10:15.929 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T12:10:15.975 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T12:10:15.992 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T12:10:16.013 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T12:10:16.050 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T12:10:16.293 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T12:10:16.307 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T12:10:16.342 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T12:10:16.379 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2024-08-31T12:10:16.399 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T12:10:16.437 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T12:10:16.637 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-paste. 2024-08-31T12:10:16.652 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T12:10:16.695 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T12:10:16.756 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T12:10:16.768 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T12:10:16.806 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T12:10:16.989 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T12:10:17.004 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T12:10:17.039 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T12:10:17.126 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T12:10:17.147 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T12:10:17.184 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T12:10:17.334 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T12:10:17.349 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T12:10:17.392 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T12:10:17.487 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T12:10:17.508 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T12:10:17.554 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T12:10:17.753 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T12:10:17.768 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T12:10:17.812 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T12:10:17.974 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T12:10:17.994 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T12:10:18.032 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T12:10:18.123 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T12:10:18.138 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T12:10:18.181 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T12:10:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T12:10:18.433 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T12:10:18.544 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T12:10:18.559 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T12:10:18.602 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T12:10:18.681 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T12:10:18.939 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-idna. 2024-08-31T12:10:18.953 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T12:10:18.988 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T12:10:19.081 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-idna. 2024-08-31T12:10:19.102 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T12:10:19.139 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T12:10:19.297 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T12:10:19.312 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T12:10:19.358 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T12:10:19.701 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T12:10:19.722 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T12:10:20.168 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T12:10:20.278 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests. 2024-08-31T12:10:20.294 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T12:10:20.327 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T12:10:20.614 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T12:10:20.630 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T12:10:20.672 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T12:10:20.771 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests. 2024-08-31T12:10:20.792 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T12:10:20.829 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T12:10:20.998 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T12:10:21.013 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:21.060 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:21.099 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T12:10:21.111 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T12:10:21.141 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T12:10:21.396 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T12:10:21.410 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:21.454 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:21.461 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T12:10:21.481 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:21.519 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:21.799 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T12:10:21.813 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T12:10:21.857 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T12:10:21.932 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T12:10:21.953 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:21.990 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:22.152 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T12:10:22.167 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T12:10:22.202 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T12:10:22.318 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T12:10:22.339 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T12:10:22.377 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T12:10:22.505 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T12:10:22.520 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:22.562 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:22.663 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T12:10:22.683 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T12:10:22.721 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T12:10:22.974 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T12:10:22.989 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:23.032 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:23.116 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T12:10:23.136 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:23.174 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:23.594 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T12:10:23.602 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T12:10:23.609 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:23.623 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:23.644 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:23.685 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:24.289 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T12:10:24.310 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:24.339 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:24.464 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph. 2024-08-31T12:10:24.478 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../068-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:24.522 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:25.058 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T12:10:25.073 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:25.116 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:25.494 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T12:10:25.509 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2024-08-31T12:10:25.509 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:25.521 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:25.552 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:25.560 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:25.870 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T12:10:25.888 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephadm. 2024-08-31T12:10:25.890 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:25.903 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../071-cephadm_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:25.919 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:25.938 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:26.283 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T12:10:26.298 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T12:10:26.331 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T12:10:26.341 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T12:10:26.352 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:26.389 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:26.677 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T12:10:26.691 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T12:10:26.735 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T12:10:26.831 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2024-08-31T12:10:26.852 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-cephadm_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:26.900 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:27.203 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T12:10:27.225 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T12:10:27.261 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T12:10:27.606 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T12:10:27.624 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T12:10:27.664 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T12:10:27.673 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-babel. 2024-08-31T12:10:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T12:10:27.723 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T12:10:27.993 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T12:10:28.007 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T12:10:28.042 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T12:10:28.362 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T12:10:28.376 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:28.420 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:28.765 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T12:10:28.779 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T12:10:28.786 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-babel. 2024-08-31T12:10:28.808 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T12:10:28.823 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T12:10:28.852 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T12:10:29.126 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-routes. 2024-08-31T12:10:29.141 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T12:10:29.185 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T12:10:29.414 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T12:10:29.435 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T12:10:29.472 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T12:10:29.546 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T12:10:29.561 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:29.604 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:29.825 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T12:10:29.846 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:29.908 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:30.254 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T12:10:30.275 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T12:10:30.320 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T12:10:30.648 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2024-08-31T12:10:30.669 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T12:10:30.714 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T12:10:31.093 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T12:10:31.114 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:31.159 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:32.036 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T12:10:32.051 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T12:10:32.094 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T12:10:32.597 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T12:10:32.612 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T12:10:32.656 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T12:10:32.984 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T12:10:32.999 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T12:10:33.144 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T12:10:33.447 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T12:10:33.462 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T12:10:33.505 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T12:10:34.131 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T12:10:34.155 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T12:10:34.181 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T12:10:34.195 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:34.197 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T12:10:34.239 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:34.701 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T12:10:34.723 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T12:10:34.768 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T12:10:35.138 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T12:10:35.160 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T12:10:35.299 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T12:10:35.400 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T12:10:35.416 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T12:10:35.459 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T12:10:35.627 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T12:10:35.649 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T12:10:35.702 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T12:10:35.803 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T12:10:35.819 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T12:10:35.862 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T12:10:36.157 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T12:10:36.172 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T12:10:36.206 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T12:10:36.428 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T12:10:36.441 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:36.485 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:36.517 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T12:10:36.533 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-31T12:10:36.575 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T12:10:36.896 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T12:10:36.912 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T12:10:36.946 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T12:10:37.241 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T12:10:37.256 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T12:10:37.299 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T12:10:37.497 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T12:10:37.519 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T12:10:37.563 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T12:10:37.652 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T12:10:37.668 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T12:10:37.710 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T12:10:37.900 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T12:10:37.922 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T12:10:37.966 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T12:10:38.047 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T12:10:38.063 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T12:10:38.105 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T12:10:38.320 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T12:10:38.342 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T12:10:38.404 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T12:10:38.723 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T12:10:38.745 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-31T12:10:38.789 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T12:10:38.819 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T12:10:38.833 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:38.877 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:39.127 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T12:10:39.148 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T12:10:39.193 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T12:10:39.221 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T12:10:39.235 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T12:10:39.279 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T12:10:39.557 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T12:10:39.572 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T12:10:39.624 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T12:10:39.813 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T12:10:39.835 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T12:10:39.880 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T12:10:39.884 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package jq. 2024-08-31T12:10:39.899 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T12:10:39.942 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T12:10:40.191 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T12:10:40.213 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T12:10:40.258 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T12:10:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package socat. 2024-08-31T12:10:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T12:10:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T12:10:40.611 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T12:10:40.633 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T12:10:40.678 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T12:10:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T12:10:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T12:10:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T12:10:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-test. 2024-08-31T12:10:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:41.442 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T12:10:41.455 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:41.491 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:41.845 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T12:10:41.867 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T12:10:41.914 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T12:10:42.256 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T12:10:42.278 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T12:10:42.347 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T12:10:42.617 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2024-08-31T12:10:42.639 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T12:10:42.683 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T12:10:42.961 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2024-08-31T12:10:42.984 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T12:10:43.028 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T12:10:43.348 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T12:10:43.370 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T12:10:43.414 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T12:10:43.523 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T12:10:43.539 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:43.581 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:43.819 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2024-08-31T12:10:43.841 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:43.902 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:44.005 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-31T12:10:44.018 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:44.060 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:44.405 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-colorama. 2024-08-31T12:10:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-31T12:10:44.463 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-31T12:10:44.724 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-shell. 2024-08-31T12:10:44.740 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:44.782 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-top. 2024-08-31T12:10:45.068 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:45.109 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:45.345 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T12:10:45.361 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:45.428 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:45.747 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T12:10:45.764 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T12:10:45.805 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T12:10:46.143 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T12:10:46.159 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T12:10:46.201 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T12:10:46.382 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T12:10:46.404 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:46.457 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:46.589 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T12:10:46.605 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T12:10:46.647 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T12:10:46.878 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-31T12:10:46.900 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:46.944 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:47.078 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package pkg-config. 2024-08-31T12:10:47.093 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T12:10:47.135 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T12:10:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-colorama. 2024-08-31T12:10:47.369 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-31T12:10:47.405 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T12:10:47.420 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T12:10:47.422 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-31T12:10:47.463 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T12:10:47.733 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-shell. 2024-08-31T12:10:47.755 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:47.808 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:47.899 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T12:10:47.914 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T12:10:47.957 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T12:10:48.129 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-top. 2024-08-31T12:10:48.151 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T12:10:48.204 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:48.268 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T12:10:48.283 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T12:10:48.326 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T12:10:48.532 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T12:10:48.554 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:48.607 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:48.621 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T12:10:48.636 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T12:10:48.696 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T12:10:48.952 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T12:10:48.965 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T12:10:48.974 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T12:10:48.981 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T12:10:49.009 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T12:10:49.023 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T12:10:49.377 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-py. 2024-08-31T12:10:49.381 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T12:10:49.392 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-31T12:10:49.403 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T12:10:49.448 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T12:10:49.451 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T12:10:49.769 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T12:10:49.785 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T12:10:49.821 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T12:10:49.852 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T12:10:49.874 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T12:10:49.918 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T12:10:50.266 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T12:10:50.282 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T12:10:50.349 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T12:10:50.382 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pkg-config. 2024-08-31T12:10:50.405 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T12:10:50.440 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T12:10:50.669 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-toml. 2024-08-31T12:10:50.677 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T12:10:50.685 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-31T12:10:50.699 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T12:10:50.727 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T12:10:50.743 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T12:10:51.030 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T12:10:51.045 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T12:10:51.080 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T12:10:51.189 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T12:10:51.211 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T12:10:51.255 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T12:10:51.442 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T12:10:51.457 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T12:10:51.500 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T12:10:51.507 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T12:10:51.520 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T12:10:51.574 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T12:10:51.769 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T12:10:51.785 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T12:10:51.836 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T12:10:51.878 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T12:10:51.900 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T12:10:51.944 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T12:10:52.264 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T12:10:52.286 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T12:10:52.330 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T12:10:52.556 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package radosgw. 2024-08-31T12:10:52.571 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../122-radosgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:52.606 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:52.667 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2024-08-31T12:10:52.689 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-31T12:10:52.733 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T12:10:53.087 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T12:10:53.109 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T12:10:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T12:10:53.475 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T12:10:53.492 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:53.533 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:53.633 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T12:10:53.655 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T12:10:53.699 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T12:10:53.836 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T12:10:54.019 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-toml. 2024-08-31T12:10:54.041 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-31T12:10:54.085 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T12:10:54.105 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T12:10:54.206 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T12:10:54.388 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T12:10:54.410 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T12:10:54.446 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T12:10:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T12:10:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T12:10:54.995 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T12:10:55.018 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T12:10:55.212 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T12:10:55.469 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T12:10:55.482 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T12:10:55.501 INFO:teuthology.orchestra.run.smithi164.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T12:10:55.511 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T12:10:55.555 INFO:teuthology.orchestra.run.smithi164.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-08-31T12:10:55.792 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:56.282 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2024-08-31T12:10:56.304 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../122-radosgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:56.318 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user cephadm....done 2024-08-31T12:10:56.348 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:56.514 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T12:10:56.790 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T12:10:57.067 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T12:10:57.192 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T12:10:57.452 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T12:10:57.534 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T12:10:57.547 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T12:10:57.584 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:57.720 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T12:10:57.838 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T12:10:57.913 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T12:10:58.147 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T12:10:58.165 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T12:10:58.291 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T12:10:58.499 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T12:10:58.581 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T12:10:58.759 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-31T12:10:58.941 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T12:10:59.026 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T12:10:59.311 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T12:10:59.415 INFO:teuthology.orchestra.run.smithi184.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T12:10:59.518 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:10:59.579 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T12:10:59.830 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T12:11:00.051 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2024-08-31T12:11:00.089 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T12:11:00.199 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T12:11:00.357 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:00.501 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T12:11:00.625 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T12:11:00.743 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T12:11:00.750 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T12:11:00.903 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T12:11:00.911 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-31T12:11:01.171 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T12:11:01.203 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T12:11:01.329 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T12:11:01.450 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T12:11:01.581 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T12:11:01.597 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T12:11:01.892 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T12:11:02.003 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T12:11:02.060 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T12:11:02.125 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T12:11:02.244 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T12:11:02.250 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T12:11:02.495 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-31T12:11:02.618 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T12:11:02.753 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T12:11:02.779 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T12:11:03.031 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T12:11:03.054 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T12:11:03.307 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T12:11:03.322 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T12:11:03.558 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T12:11:03.623 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T12:11:03.740 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T12:11:03.918 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T12:11:04.177 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:04.426 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T12:11:04.454 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T12:11:04.588 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T12:11:04.701 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T12:11:04.706 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-31T12:11:04.827 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T12:11:04.953 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T12:11:04.990 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T12:11:05.133 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T12:11:05.263 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T12:11:05.376 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T12:11:05.639 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T12:11:05.780 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T12:11:05.833 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T12:11:05.888 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T12:11:05.940 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T12:11:06.006 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T12:11:06.342 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T12:11:06.390 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T12:11:06.517 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T12:11:06.651 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-31T12:11:06.767 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T12:11:06.969 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T12:11:07.036 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T12:11:07.321 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T12:11:07.387 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T12:11:07.497 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T12:11:07.588 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T12:11:07.689 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:07.982 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T12:11:08.173 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T12:11:08.325 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T12:11:08.424 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T12:11:08.550 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T12:11:08.677 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T12:11:09.019 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T12:11:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T12:11:09.572 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T12:11:09.631 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T12:11:09.790 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:09.924 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T12:11:10.016 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T12:11:10.201 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T12:11:10.292 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-31T12:11:10.335 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T12:11:10.461 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T12:11:10.635 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T12:11:10.763 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T12:11:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T12:11:11.021 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T12:11:11.229 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T12:11:11.298 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:11.355 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:11.416 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T12:11:11.674 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T12:11:11.750 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T12:11:11.983 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T12:11:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T12:11:12.302 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T12:11:12.561 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T12:11:12.837 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T12:11:13.105 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T12:11:13.164 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T12:11:13.231 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T12:11:13.407 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:13.516 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T12:11:13.516 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T12:11:13.641 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T12:11:13.818 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T12:11:13.943 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T12:11:13.944 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T12:11:14.062 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T12:11:14.269 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T12:11:14.347 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T12:11:14.537 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T12:11:14.606 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T12:11:14.637 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T12:11:14.755 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T12:11:14.843 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T12:11:14.866 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:14.967 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T12:11:15.082 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T12:11:15.208 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T12:11:15.269 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T12:11:15.520 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T12:11:15.625 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T12:11:15.788 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T12:11:15.910 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T12:11:16.028 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T12:11:16.081 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T12:11:16.321 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:16.332 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T12:11:16.421 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T12:11:16.591 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T12:11:16.731 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T12:11:16.734 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T12:11:17.010 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T12:11:17.040 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T12:11:17.136 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T12:11:17.325 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T12:11:17.429 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T12:11:17.529 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T12:11:17.722 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T12:11:17.798 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T12:11:17.982 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T12:11:18.057 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T12:11:18.091 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T12:11:18.209 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T12:11:18.298 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T12:11:18.333 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T12:11:18.528 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T12:11:18.654 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T12:11:18.718 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T12:11:19.036 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T12:11:19.083 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T12:11:19.348 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T12:11:19.380 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T12:11:19.474 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T12:11:19.481 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:19.607 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:19.734 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T12:11:19.741 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T12:11:19.860 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T12:11:20.103 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:20.186 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T12:11:20.229 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:20.338 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T12:11:20.529 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T12:11:20.648 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:20.765 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:20.805 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T12:11:20.891 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:21.075 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T12:11:21.127 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T12:11:21.127 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T12:11:21.343 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T12:11:21.602 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T12:11:21.752 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:21.854 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T12:11:21.877 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:21.994 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:22.129 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:22.222 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T12:11:22.255 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T12:11:22.506 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T12:11:22.850 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T12:11:22.968 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.069 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.204 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T12:11:23.525 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.573 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.651 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.699 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.810 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:23.825 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T12:11:23.936 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.070 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.110 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.180 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.236 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.346 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:24.561 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T12:11:24.561 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T12:11:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:Adding group ceph....done 2024-08-31T12:11:25.081 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:25.092 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user ceph....done 2024-08-31T12:11:25.240 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:25.366 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:25.436 INFO:teuthology.orchestra.run.smithi164.stdout:Setting system user ceph properties....done 2024-08-31T12:11:25.457 INFO:teuthology.orchestra.run.smithi164.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T12:11:25.492 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:25.604 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T12:11:25.618 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T12:11:25.983 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T12:11:26.630 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:26.797 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:26.822 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:11:26.822 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:11:26.923 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.074 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.200 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.326 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.407 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.427 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:27.557 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2024-08-31T12:11:28.101 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:11:28.102 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:11:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2024-08-31T12:11:28.566 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2024-08-31T12:11:28.582 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T12:11:28.717 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T12:11:28.726 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:29.043 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T12:11:29.083 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T12:11:29.604 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:29.753 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:29.946 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:11:29.946 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:11:29.984 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T12:11:29.984 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T12:11:30.497 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:30.646 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:30.656 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:30.858 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T12:11:30.859 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T12:11:31.132 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:11:31.132 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:11:31.514 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:31.676 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:31.822 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T12:11:31.822 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T12:11:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T12:11:32.500 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:32.529 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:32.787 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T12:11:32.787 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T12:11:32.794 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:33.161 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:33.304 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:33.379 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T12:11:33.380 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T12:11:33.527 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T12:11:33.528 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T12:11:33.978 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:34.080 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:34.146 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:34.272 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:34.397 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T12:11:34.397 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T12:11:34.414 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:34.784 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T12:11:34.901 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T12:11:34.932 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:35.053 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T12:11:35.058 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:35.201 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:35.404 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T12:11:35.405 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T12:11:35.935 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:36.078 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:36.179 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T12:11:36.229 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T12:11:36.750 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T12:11:36.876 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T12:11:36.957 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T12:11:36.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-31T12:11:37.020 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T12:11:37.037 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-08-31T12:11:37.222 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-08-31T12:11:37.223 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-08-31T12:11:37.411 INFO:teuthology.orchestra.run.smithi164.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-31T12:11:37.411 INFO:teuthology.orchestra.run.smithi164.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T12:11:37.412 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T12:11:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T12:11:37.413 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T12:11:37.413 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-08-31T12:11:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-31T12:11:37.413 INFO:teuthology.orchestra.run.smithi164.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-31T12:11:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-31T12:11:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-31T12:11:37.414 INFO:teuthology.orchestra.run.smithi164.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T12:11:37.415 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-08-31T12:11:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-31T12:11:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-31T12:11:37.415 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-31T12:11:37.472 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-08-31T12:11:37.472 INFO:teuthology.orchestra.run.smithi164.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-31T12:11:37.472 INFO:teuthology.orchestra.run.smithi164.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-31T12:11:37.473 INFO:teuthology.orchestra.run.smithi164.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-31T12:11:37.473 INFO:teuthology.orchestra.run.smithi164.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-31T12:11:37.473 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-31T12:11:37.473 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-31T12:11:37.473 INFO:teuthology.orchestra.run.smithi164.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T12:11:37.474 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-08-31T12:11:37.475 INFO:teuthology.orchestra.run.smithi164.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-31T12:11:37.661 INFO:teuthology.orchestra.run.smithi164.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-08-31T12:11:37.661 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 55.8 MB of archives. 2024-08-31T12:11:37.661 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-31T12:11:37.661 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-31T12:11:38.284 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-31T12:11:38.300 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-31T12:11:38.324 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T12:11:38.425 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-31T12:11:38.425 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-31T12:11:38.426 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-31T12:11:38.455 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-31T12:11:38.456 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-31T12:11:38.459 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-31T12:11:38.465 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-31T12:11:38.465 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-31T12:11:38.465 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-31T12:11:38.529 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-31T12:11:38.529 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-31T12:11:38.529 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-31T12:11:38.610 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-31T12:11:38.998 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T12:11:39.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-31T12:11:39.101 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-08-31T12:11:39.291 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-31T12:11:39.293 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-31T12:11:39.293 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-31T12:11:39.296 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-31T12:11:39.296 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-31T12:11:39.301 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-08-31T12:11:39.302 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-31T12:11:39.312 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-08-31T12:11:39.313 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-08-31T12:11:39.352 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-31T12:11:39.353 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-31T12:11:39.429 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-31T12:11:39.436 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-31T12:11:39.447 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T12:11:39.523 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T12:11:39.524 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-31T12:11:39.524 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T12:11:39.524 INFO:teuthology.orchestra.run.smithi184.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T12:11:39.524 INFO:teuthology.orchestra.run.smithi184.stdout: python2.7-minimal 2024-08-31T12:11:39.524 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T12:11:39.525 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-08-31T12:11:39.525 INFO:teuthology.orchestra.run.smithi184.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-31T12:11:39.525 INFO:teuthology.orchestra.run.smithi184.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-31T12:11:39.526 INFO:teuthology.orchestra.run.smithi184.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-31T12:11:39.526 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-31T12:11:39.526 INFO:teuthology.orchestra.run.smithi184.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T12:11:39.527 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-08-31T12:11:39.527 INFO:teuthology.orchestra.run.smithi184.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-31T12:11:39.527 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-31T12:11:39.527 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-31T12:11:39.528 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-31T12:11:39.528 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-31T12:11:39.528 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-31T12:11:39.529 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-08-31T12:11:39.544 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-31T12:11:39.546 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-08-31T12:11:39.573 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-08-31T12:11:39.573 INFO:teuthology.orchestra.run.smithi184.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-31T12:11:39.573 INFO:teuthology.orchestra.run.smithi184.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-31T12:11:39.574 INFO:teuthology.orchestra.run.smithi184.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-31T12:11:39.574 INFO:teuthology.orchestra.run.smithi184.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-31T12:11:39.574 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-31T12:11:39.575 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-31T12:11:39.575 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T12:11:39.576 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2024-08-31T12:11:39.577 INFO:teuthology.orchestra.run.smithi184.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-31T12:11:39.759 INFO:teuthology.orchestra.run.smithi184.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-08-31T12:11:39.759 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 55.8 MB of archives. 2024-08-31T12:11:39.759 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-31T12:11:39.759 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-31T12:11:40.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-31T12:11:40.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-31T12:11:40.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-31T12:11:40.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-31T12:11:40.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-31T12:11:40.031 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-31T12:11:40.045 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-31T12:11:40.094 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-31T12:11:40.378 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-31T12:11:40.394 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-31T12:11:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:Preconfiguring packages ... 2024-08-31T12:11:40.518 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-31T12:11:40.519 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-31T12:11:40.521 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-31T12:11:40.549 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-31T12:11:40.551 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-31T12:11:40.554 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-31T12:11:40.557 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-31T12:11:40.558 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-31T12:11:40.560 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-31T12:11:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 55.8 MB in 3s (21.4 MB/s) 2024-08-31T12:11:40.622 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-31T12:11:40.623 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-31T12:11:40.623 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-31T12:11:40.704 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-31T12:11:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143281 files and directories currently installed.) 2024-08-31T12:11:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:41.490 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-31T12:11:41.494 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-31T12:11:41.494 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-31T12:11:41.500 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-31T12:11:41.550 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-31T12:11:41.561 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-08-31T12:11:41.565 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-31T12:11:41.582 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-31T12:11:41.583 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-31T12:11:41.622 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-31T12:11:41.658 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-31T12:11:41.673 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-31T12:11:41.764 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-31T12:11:41.769 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-31T12:11:41.770 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-31T12:11:41.771 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-31T12:11:41.772 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-08-31T12:11:41.828 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-31T12:11:41.830 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-08-31T12:11:41.896 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-31T12:11:42.398 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-31T12:11:42.398 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-31T12:11:42.398 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-31T12:11:42.398 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-31T12:11:42.399 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-31T12:11:42.399 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-31T12:11:42.421 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-31T12:11:42.422 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-31T12:11:42.846 INFO:teuthology.orchestra.run.smithi184.stdout:Preconfiguring packages ... 2024-08-31T12:11:42.985 INFO:teuthology.orchestra.run.smithi164.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-31T12:11:43.013 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 55.8 MB in 3s (19.5 MB/s) 2024-08-31T12:11:43.233 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package flex. 2024-08-31T12:11:43.304 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143281 files and directories currently installed.) 2024-08-31T12:11:43.307 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:43.315 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140857 files and directories currently installed.) 2024-08-31T12:11:43.320 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:43.340 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-31T12:11:43.489 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:43.868 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T12:11:44.062 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-31T12:11:44.167 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-31T12:11:44.442 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:11:45.007 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143354 files and directories currently installed.) 2024-08-31T12:11:45.010 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:45.123 INFO:teuthology.orchestra.run.smithi184.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-31T12:11:45.153 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:45.421 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package flex. 2024-08-31T12:11:45.509 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140857 files and directories currently installed.) 2024-08-31T12:11:45.514 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:45.548 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:45.568 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-31T12:11:45.701 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T12:11:46.146 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T12:11:46.316 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-31T12:11:46.426 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package bison. 2024-08-31T12:11:46.496 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143354 files and directories currently installed.) 2024-08-31T12:11:46.499 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-31T12:11:46.545 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T12:11:46.758 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:11:47.021 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-31T12:11:47.036 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-31T12:11:47.079 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T12:11:47.347 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140930 files and directories currently installed.) 2024-08-31T12:11:47.351 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:47.440 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package dump. 2024-08-31T12:11:47.455 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-31T12:11:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking dump (0.4b47-3) ... 2024-08-31T12:11:47.507 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:47.794 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package indent. 2024-08-31T12:11:47.808 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:47.844 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T12:11:48.071 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T12:11:48.071 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-31T12:11:48.086 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-31T12:11:48.130 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T12:11:48.190 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T12:11:48.442 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-31T12:11:48.456 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-31T12:11:48.500 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T12:11:48.565 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T12:11:48.761 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-31T12:11:48.776 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-31T12:11:48.853 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T12:11:48.957 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package bison. 2024-08-31T12:11:49.048 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140930 files and directories currently installed.) 2024-08-31T12:11:49.053 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-31T12:11:49.109 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T12:11:49.173 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-31T12:11:49.188 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:49.231 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T12:11:49.484 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-31T12:11:49.499 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:49.533 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T12:11:49.577 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-31T12:11:49.599 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-31T12:11:49.635 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T12:11:49.761 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjson-perl. 2024-08-31T12:11:49.776 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-31T12:11:49.819 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-31T12:11:50.089 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package dump. 2024-08-31T12:11:50.111 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-31T12:11:50.164 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking dump (0.4b47-3) ... 2024-08-31T12:11:50.173 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-31T12:11:50.188 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-31T12:11:50.231 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T12:11:50.459 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package indent. 2024-08-31T12:11:50.482 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:50.525 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T12:11:50.820 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-31T12:11:50.843 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-31T12:11:50.886 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T12:11:51.283 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-31T12:11:51.305 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-31T12:11:51.384 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T12:11:51.509 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-31T12:11:51.525 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T12:11:51.559 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:11:51.685 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-31T12:11:51.707 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-31T12:11:51.760 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T12:11:51.879 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-31T12:11:51.895 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T12:11:51.937 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:11:52.089 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-31T12:11:52.111 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:52.155 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T12:11:52.265 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-31T12:11:52.281 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T12:11:52.348 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:11:52.425 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-31T12:11:52.447 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-31T12:11:52.500 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T12:11:52.676 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-31T12:11:52.692 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-31T12:11:52.726 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T12:11:52.811 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjson-perl. 2024-08-31T12:11:52.824 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-31T12:11:52.861 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-31T12:11:53.087 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-31T12:11:53.104 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T12:11:53.146 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T12:11:53.315 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-31T12:11:53.338 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-31T12:11:53.390 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T12:11:53.515 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-31T12:11:53.532 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:53.573 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:11:53.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-31T12:11:53.883 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:53.917 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:11:54.212 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-31T12:11:54.228 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:54.271 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:11:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-31T12:11:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T12:11:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:11:55.143 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-31T12:11:55.158 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-31T12:11:55.193 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-31T12:11:55.201 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T12:11:55.216 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T12:11:55.276 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:11:55.554 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package modemmanager. 2024-08-31T12:11:55.570 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T12:11:55.571 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-31T12:11:55.594 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T12:11:55.629 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:11:55.637 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:11:56.040 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-31T12:11:56.063 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T12:11:56.115 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:11:56.310 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager. 2024-08-31T12:11:56.326 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T12:11:56.369 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-31T12:11:56.560 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-31T12:11:56.583 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-31T12:11:56.635 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T12:11:57.063 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-31T12:11:57.086 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T12:11:57.130 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T12:11:57.528 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ppp. 2024-08-31T12:11:57.543 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-31T12:11:57.558 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-31T12:11:57.581 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:57.633 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:11:57.891 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T12:11:58.120 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-31T12:11:58.144 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:58.206 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package pptp-linux. 2024-08-31T12:11:58.221 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-31T12:11:58.265 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-31T12:11:58.348 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:11:58.525 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-31T12:11:58.540 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-31T12:11:58.584 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-31T12:11:58.903 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-31T12:11:58.918 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-31T12:11:58.953 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-common (238) ... 2024-08-31T12:11:59.249 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-31T12:11:59.257 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-31T12:11:59.262 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:59.271 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:11:59.299 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:11:59.315 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:11:59.568 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-31T12:11:59.590 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T12:11:59.634 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:11:59.903 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-common. 2024-08-31T12:11:59.918 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-31T12:12:00.013 INFO:teuthology.orchestra.run.smithi164.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-31T12:12:00.044 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-common (238) ... 2024-08-31T12:12:00.263 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-31T12:12:00.285 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-31T12:12:00.330 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T12:12:00.527 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-14. 2024-08-31T12:12:00.542 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:12:00.588 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:00.733 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package modemmanager. 2024-08-31T12:12:00.755 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T12:12:00.800 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:12:01.441 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager. 2024-08-31T12:12:01.462 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T12:12:01.515 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-31T12:12:01.680 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql. 2024-08-31T12:12:01.694 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-31T12:12:01.756 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql (14+238) ... 2024-08-31T12:12:02.006 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client. 2024-08-31T12:12:02.021 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-31T12:12:02.064 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client (14+238) ... 2024-08-31T12:12:02.273 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ppp. 2024-08-31T12:12:02.295 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-31T12:12:02.350 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-31T12:12:02.365 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-31T12:12:02.408 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-31T12:12:02.610 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T12:12:02.686 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl8.6. 2024-08-31T12:12:02.701 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-31T12:12:02.735 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T12:12:02.953 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pptp-linux. 2024-08-31T12:12:02.975 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-31T12:12:03.019 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-31T12:12:03.047 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl. 2024-08-31T12:12:03.061 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-31T12:12:03.109 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-31T12:12:03.305 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-31T12:12:03.328 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-31T12:12:03.380 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-31T12:12:03.483 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package wpasupplicant. 2024-08-31T12:12:03.497 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-31T12:12:03.541 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T12:12:03.708 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-31T12:12:03.731 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-31T12:12:03.775 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-common (238) ... 2024-08-31T12:12:03.878 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-31T12:12:03.893 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-31T12:12:03.961 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-31T12:12:04.045 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-31T12:12:04.068 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:12:04.104 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:04.333 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-31T12:12:04.348 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-31T12:12:04.399 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T12:12:04.716 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-common (238) ... 2024-08-31T12:12:04.750 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-common. 2024-08-31T12:12:04.773 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-31T12:12:04.828 INFO:teuthology.orchestra.run.smithi184.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-31T12:12:04.849 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-common (238) ... 2024-08-31T12:12:04.922 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-31T12:12:05.082 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T12:12:05.208 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:05.334 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T12:12:05.358 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-14. 2024-08-31T12:12:05.381 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T12:12:05.428 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:05.460 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T12:12:05.603 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:06.539 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-31T12:12:06.666 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T12:12:06.778 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql. 2024-08-31T12:12:06.801 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-31T12:12:06.844 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql (14+238) ... 2024-08-31T12:12:07.046 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T12:12:07.046 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T12:12:07.088 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client. 2024-08-31T12:12:07.111 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-31T12:12:07.146 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client (14+238) ... 2024-08-31T12:12:07.399 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-31T12:12:07.422 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-31T12:12:07.465 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-31T12:12:07.793 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package tcl8.6. 2024-08-31T12:12:07.816 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-31T12:12:07.828 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T12:12:07.859 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T12:12:07.945 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T12:12:08.071 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:12:08.171 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package tcl. 2024-08-31T12:12:08.193 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-31T12:12:08.197 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-31T12:12:08.242 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-31T12:12:08.348 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T12:12:08.474 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T12:12:08.592 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package wpasupplicant. 2024-08-31T12:12:08.600 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T12:12:08.614 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-31T12:12:08.665 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T12:12:08.726 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T12:12:09.036 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-31T12:12:09.049 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-31T12:12:09.103 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-31T12:12:09.415 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T12:12:09.541 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up dump (0.4b47-3) ... 2024-08-31T12:12:09.636 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-31T12:12:09.701 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:12:09.827 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T12:12:09.978 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-31T12:12:10.057 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-31T12:12:10.080 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-31T12:12:10.104 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-31T12:12:10.132 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T12:12:10.232 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T12:12:10.311 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-31T12:12:10.390 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T12:12:10.426 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-common (238) ... 2024-08-31T12:12:10.549 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T12:12:10.663 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-31T12:12:10.725 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T12:12:10.789 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T12:12:10.851 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:12:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:10.977 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-31T12:12:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T12:12:11.162 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client (14+238) ... 2024-08-31T12:12:11.192 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T12:12:11.263 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-31T12:12:11.318 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:11.821 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-31T12:12:11.832 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:11.832 INFO:teuthology.orchestra.run.smithi164.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-31T12:12:11.832 INFO:teuthology.orchestra.run.smithi164.stdout:which means they are currently configured by ifupdown: 2024-08-31T12:12:11.832 INFO:teuthology.orchestra.run.smithi164.stdout:- enp3s0f1 2024-08-31T12:12:11.832 INFO:teuthology.orchestra.run.smithi164.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-31T12:12:11.833 INFO:teuthology.orchestra.run.smithi164.stdout:remove their configuration from /etc/network/interfaces. 2024-08-31T12:12:11.833 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:11.907 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T12:12:11.965 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-31T12:12:12.286 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T12:12:12.287 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T12:12:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-31T12:12:12.772 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-31T12:12:12.835 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T12:12:13.003 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T12:12:13.121 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T12:12:13.247 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-31T12:12:13.382 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T12:12:13.449 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:12:13.508 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T12:12:13.600 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T12:12:13.659 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T12:12:13.751 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-31T12:12:13.877 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-common (238) ... 2024-08-31T12:12:13.894 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T12:12:14.782 INFO:teuthology.orchestra.run.smithi164.stdout:Adding user postgres to group ssl-cert 2024-08-31T12:12:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:15.055 INFO:teuthology.orchestra.run.smithi164.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-31T12:12:15.316 INFO:teuthology.orchestra.run.smithi164.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-31T12:12:15.316 INFO:teuthology.orchestra.run.smithi164.stdout:Removing obsolete dictionary files: 2024-08-31T12:12:15.381 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T12:12:15.625 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up dump (0.4b47-3) ... 2024-08-31T12:12:15.719 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-31T12:12:15.786 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:12:15.887 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T12:12:16.047 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-31T12:12:16.058 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-31T12:12:16.181 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-31T12:12:16.307 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T12:12:16.398 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-31T12:12:16.467 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T12:12:16.536 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:16.618 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T12:12:16.788 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T12:12:16.859 INFO:teuthology.orchestra.run.smithi164.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-31T12:12:16.881 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-31T12:12:16.895 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:This user must also own the server process. 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:The database cluster will be initialized with locale "en_US". 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:The default text search configuration will be set to "english". 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:Data page checksums are disabled. 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:16.937 INFO:teuthology.orchestra.run.smithi164.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-31T12:12:16.938 INFO:teuthology.orchestra.run.smithi164.stdout:creating subdirectories ... ok 2024-08-31T12:12:16.938 INFO:teuthology.orchestra.run.smithi164.stdout:selecting dynamic shared memory implementation ... posix 2024-08-31T12:12:16.961 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default max_connections ... 100 2024-08-31T12:12:16.995 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default shared_buffers ... 128MB 2024-08-31T12:12:17.005 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-31T12:12:17.009 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default time zone ... Etc/UTC 2024-08-31T12:12:17.010 INFO:teuthology.orchestra.run.smithi164.stdout:creating configuration files ... ok 2024-08-31T12:12:17.171 INFO:teuthology.orchestra.run.smithi164.stdout:running bootstrap script ... ok 2024-08-31T12:12:17.200 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client (14+238) ... 2024-08-31T12:12:17.332 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-31T12:12:17.787 INFO:teuthology.orchestra.run.smithi164.stdout:performing post-bootstrap initialization ... ok 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout:which means they are currently configured by ifupdown: 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout:- enp3s0f1 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-31T12:12:17.840 INFO:teuthology.orchestra.run.smithi184.stdout:remove their configuration from /etc/network/interfaces. 2024-08-31T12:12:17.841 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:17.956 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-31T12:12:18.305 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-31T12:12:18.334 INFO:teuthology.orchestra.run.smithi164.stdout:syncing data to disk ... ok 2024-08-31T12:12:18.691 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-31T12:12:18.830 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-31T12:12:19.293 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T12:12:19.428 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T12:12:19.546 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-31T12:12:19.714 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-common (238) ... 2024-08-31T12:12:20.669 INFO:teuthology.orchestra.run.smithi184.stdout:Adding user postgres to group ssl-cert 2024-08-31T12:12:20.856 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:20.856 INFO:teuthology.orchestra.run.smithi184.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-31T12:12:21.081 INFO:teuthology.orchestra.run.smithi184.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-31T12:12:21.081 INFO:teuthology.orchestra.run.smithi184.stdout:Removing obsolete dictionary files: 2024-08-31T12:12:21.714 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-31T12:12:21.918 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:12:22.069 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-31T12:12:22.151 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T12:12:22.170 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql (14+238) ... 2024-08-31T12:12:22.296 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:12:22.430 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:12:22.485 INFO:teuthology.orchestra.run.smithi184.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-31T12:12:22.510 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout:This user must also own the server process. 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout:The database cluster will be initialized with locale "en_US". 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-31T12:12:22.556 INFO:teuthology.orchestra.run.smithi184.stdout:The default text search configuration will be set to "english". 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout:Data page checksums are disabled. 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout:creating subdirectories ... ok 2024-08-31T12:12:22.557 INFO:teuthology.orchestra.run.smithi184.stdout:selecting dynamic shared memory implementation ... posix 2024-08-31T12:12:22.572 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default max_connections ... 100 2024-08-31T12:12:22.592 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default shared_buffers ... 128MB 2024-08-31T12:12:22.602 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default time zone ... Etc/UTC 2024-08-31T12:12:22.602 INFO:teuthology.orchestra.run.smithi184.stdout:creating configuration files ... ok 2024-08-31T12:12:22.715 INFO:teuthology.orchestra.run.smithi184.stdout:running bootstrap script ... ok 2024-08-31T12:12:22.716 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T12:12:22.716 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T12:12:23.348 INFO:teuthology.orchestra.run.smithi184.stdout:performing post-bootstrap initialization ... ok 2024-08-31T12:12:23.458 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T12:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-31T12:12:23.885 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T12:12:24.029 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T12:12:24.154 INFO:teuthology.orchestra.run.smithi184.stdout:syncing data to disk ... ok 2024-08-31T12:12:24.556 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-31T12:12:25.456 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-31T12:12:25.565 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T12:12:26.111 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T12:12:26.117 DEBUG:teuthology.parallel:result is None 2024-08-31T12:12:27.516 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:12:27.667 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-31T12:12:27.793 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql (14+238) ... 2024-08-31T12:12:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T12:12:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T12:12:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T12:12:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T12:12:28.914 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T12:12:29.015 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-31T12:12:29.309 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T12:12:29.502 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T12:12:31.153 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-31T12:12:31.253 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T12:12:31.809 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T12:12:31.815 DEBUG:teuthology.parallel:result is None 2024-08-31T12:12:31.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:12:31.956 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-query -W -f '${Version}' ceph 2024-08-31T12:12:31.980 INFO:teuthology.orchestra.run.smithi164.stdout:19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:12:31.980 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:12:31.981 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560-gd19e6118-1jammy is installed. 2024-08-31T12:12:31.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:12:32.132 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2024-08-31T12:12:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:12:32.153 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T12:12:32.153 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560-gd19e6118-1jammy is installed. 2024-08-31T12:12:32.155 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T12:12:32.155 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:32.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T12:12:32.177 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:32.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T12:12:32.212 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T12:12:32.212 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:32.212 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T12:12:32.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T12:12:32.301 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:32.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T12:12:32.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T12:12:32.369 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T12:12:32.369 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:32.369 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T12:12:32.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T12:12:32.452 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:32.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T12:12:32.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T12:12:32.523 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T12:12:32.524 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:32.524 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T12:12:32.543 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T12:12:32.604 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:32.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T12:12:32.617 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T12:12:32.671 INFO:teuthology.run_tasks:Running task ceph... 2024-08-31T12:12:32.767 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-31T12:12:32.767 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-08-31T12:12:32.771 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-08-31T12:12:32.787 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-31T12:12:32.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-31T12:12:32.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-31T12:12:32.848 INFO:tasks.ceph:Creating extra log directories... 2024-08-31T12:12:32.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-31T12:12:32.892 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-31T12:12:32.917 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-31T12:12:32.918 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-31T12:12:32.918 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-31T12:12:32.918 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:32.918 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-31T12:12:32.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-31T12:12:33.051 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:33.052 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-31T12:12:33.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-31T12:12:33.137 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-31T12:12:33.137 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-31T12:12:33.137 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495', 'branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7881495', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20240828.085847-main-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5413, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'sleep_before_teardown': 0, 'subset': '347/512', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKN3yDkbZHSJgUI6ieHrklQZ9Vm61iFZZcHCFexEflKJUyHTjn5eRmFEuW8M2juZVJZaV/orOGdCo8km5mJ27k8=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSSu9agWFpkuC6uj6tys7u2nS9uZJTcGA3WvtMg0emMMxjl1YIgRCCGBTBrNTM58s8A1zFxrkNH+lHzS+tI20o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Replacing daemon mds'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'cluster': 'ceph'}}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-08-30_08:30:37', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-31T12:12:33.138 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-31T12:12:33.142 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-31T12:12:33.180 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-08-31T12:12:33.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-08-31T12:12:33.236 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:33.236 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T12:12:33.261 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T12:12:33.261 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 884 Links: 1 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-08-31 12:05:52.749301200 +0000 2024-08-31T12:12:33.312 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-08-31 12:05:52.473303664 +0000 2024-08-31T12:12:33.313 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-08-31 12:05:52.473303664 +0000 2024-08-31T12:12:33.313 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-08-31 12:05:52.473303664 +0000 2024-08-31T12:12:33.313 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T12:12:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-08-31T12:12:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-08-31T12:12:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000390316 s, 1.3 MB/s 2024-08-31T12:12:33.376 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T12:12:33.426 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-08-31T12:12:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T12:12:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 902 Links: 1 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-08-31 12:05:53.289296377 +0000 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-08-31 12:05:53.057298449 +0000 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-08-31 12:05:53.057298449 +0000 2024-08-31T12:12:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-08-31 12:05:53.057298449 +0000 2024-08-31T12:12:33.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T12:12:33.541 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-08-31T12:12:33.542 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-08-31T12:12:33.542 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000361166 s, 1.4 MB/s 2024-08-31T12:12:33.544 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T12:12:33.598 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-08-31T12:12:33.648 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T12:12:33.648 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 919 Links: 1 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-08-31 12:05:53.601293589 +0000 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-08-31 12:05:53.597293625 +0000 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-08-31 12:05:53.597293625 +0000 2024-08-31T12:12:33.649 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-08-31 12:05:53.597293625 +0000 2024-08-31T12:12:33.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T12:12:33.710 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-08-31T12:12:33.710 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-08-31T12:12:33.710 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000366915 s, 1.4 MB/s 2024-08-31T12:12:33.711 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T12:12:33.762 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-08-31T12:12:33.812 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-08-31 12:05:54.409286372 +0000 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-08-31 12:05:54.141288765 +0000 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-08-31 12:05:54.141288765 +0000 2024-08-31T12:12:33.813 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-08-31 12:05:54.141288765 +0000 2024-08-31T12:12:33.813 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T12:12:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-08-31T12:12:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-08-31T12:12:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.00036186 s, 1.4 MB/s 2024-08-31T12:12:33.875 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T12:12:33.926 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:33.926 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:33.926 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T12:12:33.932 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T12:12:33.932 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-08-31 12:05:33.445952575 +0000 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-08-31 12:05:33.173966158 +0000 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-08-31 12:05:33.173966158 +0000 2024-08-31T12:12:33.985 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-08-31T12:12:33.986 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T12:12:34.038 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-08-31T12:12:34.039 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-08-31T12:12:34.039 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000508896 s, 1.0 MB/s 2024-08-31T12:12:34.040 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T12:12:34.089 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-08-31T12:12:34.136 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T12:12:34.136 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-08-31 12:05:33.985925612 +0000 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-08-31 12:05:33.705939593 +0000 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-08-31 12:05:33.705939593 +0000 2024-08-31T12:12:34.137 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-08-31T12:12:34.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T12:12:34.191 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-08-31T12:12:34.191 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-08-31T12:12:34.191 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000494214 s, 1.0 MB/s 2024-08-31T12:12:34.193 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T12:12:34.241 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-08-31 12:05:34.493900735 +0000 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-08-31 12:05:34.233913457 +0000 2024-08-31T12:12:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-08-31 12:05:34.233913457 +0000 2024-08-31T12:12:34.289 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-08-31T12:12:34.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T12:12:34.343 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-08-31T12:12:34.343 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-08-31T12:12:34.343 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000569416 s, 899 kB/s 2024-08-31T12:12:34.345 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T12:12:34.393 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-08-31 12:05:34.989876465 +0000 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-08-31 12:05:34.733888991 +0000 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-08-31 12:05:34.733888991 +0000 2024-08-31T12:12:34.444 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-08-31T12:12:34.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T12:12:34.498 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-08-31T12:12:34.517 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-08-31T12:12:34.517 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000460126 s, 1.1 MB/s 2024-08-31T12:12:34.518 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T12:12:34.565 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:34.565 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-31T12:12:34.565 INFO:tasks.ceph:Generating config... 2024-08-31T12:12:34.567 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-08-31T12:12:34.567 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-31T12:12:34.567 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-31T12:12:34.568 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-31T12:12:34.568 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-31T12:12:34.568 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-08-31T12:12:34.569 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-31T12:12:34.569 INFO:tasks.ceph:Setting up mon.a... 2024-08-31T12:12:34.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-31T12:12:34.629 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.keyring 2024-08-31T12:12:34.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-31T12:12:34.700 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T12:12:34.719 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.164'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2024-08-31T12:12:34.720 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.164,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}} 2024-08-31T12:12:34.720 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:34.721 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-31T12:12:34.768 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.164 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:34.870 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:34.870 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: generated fsid 0ef23008-1eb0-48b8-823b-3324ee9f8086 2024-08-31T12:12:34.870 INFO:teuthology.orchestra.run.smithi164.stdout:setting min_mon_release = quincy 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:epoch 0 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:fsid 0ef23008-1eb0-48b8-823b-3324ee9f8086 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:last_changed 2024-08-31T12:12:34.872447+0000 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:created 2024-08-31T12:12:34.872447+0000 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:min_mon_release 17 (quincy) 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:election_strategy: 1 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2024-08-31T12:12:34.871 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-31T12:12:34.874 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-31T12:12:34.882 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ef23008-1eb0-48b8-823b-3324ee9f8086... 2024-08-31T12:12:34.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-31T12:12:34.927 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.958 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-08-31T12:12:34.959 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-08-31T12:12:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-08-31T12:12:34.961 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.164,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 0ef23008-1eb0-48b8-823b-3324ee9f8086 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.962 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-08-31T12:12:34.963 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-08-31T12:12:34.964 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay max = 1 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay probability = 0.005 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay type = client mds 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 2500 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: osd blocked scrub grace period = 3600 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: osd max markdown count = 1000 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-08-31T12:12:34.965 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-08-31T12:12:34.966 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-08-31T12:12:34.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon down mkfs grace = 300 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout: client_shutdown_timeout = 120 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.e] 2024-08-31T12:12:34.968 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.f] 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: mds oft prefetch dirfrags = True 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: mds_sleep_rank_change = 5000000.0 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay max = 1 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay probability = 0.005 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject delay type = client mds osd 2024-08-31T12:12:34.969 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 2500 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.970 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.971 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-08-31T12:12:34.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.164,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 0ef23008-1eb0-48b8-823b-3324ee9f8086 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-08-31T12:12:34.973 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-08-31T12:12:34.975 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon client directed command retry = 5 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay max = 1 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay probability = 0.005 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay type = client mds 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject socket failures = 2500 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-08-31T12:12:34.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-08-31T12:12:34.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.978 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-08-31T12:12:34.979 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout: client_shutdown_timeout = 120 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout: mds oft prefetch dirfrags = True 2024-08-31T12:12:34.980 INFO:teuthology.orchestra.run.smithi164.stdout: mds_sleep_rank_change = 5000000.0 2024-08-31T12:12:34.981 INFO:teuthology.orchestra.run.smithi164.stdout: mon client directed command retry = 5 2024-08-31T12:12:34.981 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay max = 1 2024-08-31T12:12:34.981 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay probability = 0.005 2024-08-31T12:12:34.981 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject delay type = client mds osd 2024-08-31T12:12:34.981 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject socket failures = 2500 2024-08-31T12:12:34.982 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-31T12:12:34.982 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-31T12:12:35.091 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-31T12:12:35.091 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:35.091 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-31T12:12:35.099 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:35.100 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-31T12:12:35.148 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:12:35.148 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:35.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-31T12:12:35.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T12:12:35.218 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:12:35.218 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:35.269 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:12:35.269 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:35.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-31T12:12:35.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T12:12:35.292 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:12:35.292 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:35.340 INFO:tasks.ceph:Setting up mon nodes... 2024-08-31T12:12:35.340 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-31T12:12:35.340 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-31T12:12:35.404 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-31T12:12:35.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-31T12:12:35.484 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-31T12:12:35.510 INFO:tasks.ceph:Setting up mds nodes... 2024-08-31T12:12:35.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-31T12:12:35.576 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-31T12:12:35.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-31T12:12:35.600 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-31T12:12:35.711 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-31T12:12:35.716 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-31T12:12:35.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-08-31T12:12:35.843 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-08-31T12:12:35.849 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-08-31T12:12:35.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-31T12:12:35.946 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-31T12:12:35.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-31T12:12:35.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-31T12:12:36.077 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-31T12:12:36.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-31T12:12:36.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-08-31T12:12:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-08-31T12:12:36.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-08-31T12:12:36.221 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-31T12:12:36.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T12:12:36.273 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-31T12:12:36.290 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-31T12:12:36.291 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-31T12:12:36.291 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-31T12:12:36.310 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:36.310 INFO:tasks.ceph:role: osd.0 2024-08-31T12:12:36.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:12:36.311 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:36.379 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:36.794 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-08-31T12:12:36.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-08-31T12:12:36.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-31T12:12:36.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-31T12:12:36.933 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:36.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:36.934 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-31T12:12:36.999 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:36.999 INFO:tasks.ceph:role: osd.1 2024-08-31T12:12:36.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:12:36.999 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-31T12:12:37.070 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:37.070 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:37.070 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:37.071 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:37.440 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-08-31T12:12:37.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-08-31T12:12:37.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-31T12:12:37.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-31T12:12:37.575 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:37.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:37.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-31T12:12:37.638 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:37.638 INFO:tasks.ceph:role: osd.2 2024-08-31T12:12:37.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:12:37.638 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-31T12:12:37.710 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:37.711 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-08-31T12:12:38.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-08-31T12:12:38.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-31T12:12:38.207 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-31T12:12:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:38.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:38.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-31T12:12:38.291 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:38.291 INFO:tasks.ceph:role: osd.3 2024-08-31T12:12:38.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:12:38.291 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:38.359 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:38.759 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-08-31T12:12:38.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-08-31T12:12:38.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-31T12:12:38.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-31T12:12:38.886 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:38.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:38.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:39.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:39.019+0000 7f248f68c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-31T12:12:39.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:39.027+0000 7f248f68c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-31T12:12:39.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:39.031+0000 7f248f68c7c0 -1 bdev(0x555d6c64ea00 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:39.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:39.031+0000 7f248f68c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-31T12:12:42.264 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T12:12:42.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:42.387+0000 7f01acc597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-31T12:12:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:42.391+0000 7f01acc597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-31T12:12:42.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:42.391+0000 7f01acc597c0 -1 bdev(0x5624ca108a00 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:42.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:42.391+0000 7f01acc597c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-31T12:12:45.644 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T12:12:45.664 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:45.771+0000 7f4fd19517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-31T12:12:45.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:45.771+0000 7f4fd19517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-31T12:12:45.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:45.771+0000 7f4fd19517c0 -1 bdev(0x559ef8304a00 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:45.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:45.771+0000 7f4fd19517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-31T12:12:49.032 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T12:12:49.052 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:49.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:49.159+0000 7f3d403077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-31T12:12:49.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:49.159+0000 7f3d403077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-31T12:12:49.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:49.159+0000 7f3d403077c0 -1 bdev(0x56413b0d0a00 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:49.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:12:49.159+0000 7f3d403077c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-31T12:12:52.420 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T12:12:52.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-31T12:12:52.454 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:52.455 INFO:tasks.ceph:role: osd.4 2024-08-31T12:12:52.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:12:52.455 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-31T12:12:52.519 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:52.520 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:52.977 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-08-31T12:12:52.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-08-31T12:12:52.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-31T12:12:53.083 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-31T12:12:53.093 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:53.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:53.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-31T12:12:53.146 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:53.146 INFO:tasks.ceph:role: osd.5 2024-08-31T12:12:53.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:12:53.146 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:53.208 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:53.209 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:53.209 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:53.209 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:53.209 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:53.677 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-08-31T12:12:53.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-08-31T12:12:53.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-31T12:12:53.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-31T12:12:53.819 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:53.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:53.820 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-31T12:12:53.873 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:53.873 INFO:tasks.ceph:role: osd.6 2024-08-31T12:12:53.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:12:53.873 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:53.936 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:53.937 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:53.937 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:53.937 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:54.414 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-08-31T12:12:54.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-08-31T12:12:54.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-31T12:12:54.561 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-31T12:12:54.572 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:54.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:54.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-31T12:12:54.627 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T12:12:54.627 INFO:tasks.ceph:role: osd.7 2024-08-31T12:12:54.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:12:54.627 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T12:12:54.691 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T12:12:55.121 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-08-31T12:12:55.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-08-31T12:12:55.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-31T12:12:55.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-31T12:12:55.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:12:55.226 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T12:12:55.226 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:55.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:55.373+0000 7f6344e157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-31T12:12:55.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:55.373+0000 7f6344e157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-31T12:12:55.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:55.377+0000 7f6344e157c0 -1 bdev(0x55fe6b9aaa00 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:55.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:55.377+0000 7f6344e157c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-31T12:12:58.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T12:12:58.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:12:58.660 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:58.657+0000 7fd4007287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-31T12:12:58.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:58.657+0000 7fd4007287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-31T12:12:58.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:58.657+0000 7fd4007287c0 -1 bdev(0x55c70bd72a00 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-31T12:12:58.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:12:58.657+0000 7fd4007287c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-31T12:13:01.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T12:13:01.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:13:01.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:01.925+0000 7f8b864287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-31T12:13:01.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:01.929+0000 7f8b864287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-31T12:13:01.932 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:01.929+0000 7f8b864287c0 -1 bdev(0x556d50f60a00 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-08-31T12:13:01.932 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:01.929+0000 7f8b864287c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-31T12:13:03.140 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:13:03.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:13:05.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-31T12:13:05.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:13:05.200 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:05.197+0000 7f1ec21c67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-31T12:13:05.201 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:05.197+0000 7f1ec21c67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-31T12:13:05.201 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:05.197+0000 7f1ec21c67c0 -1 bdev(0x557b827eaa00 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-08-31T12:13:05.201 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:05.197+0000 7f1ec21c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-31T12:13:08.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-31T12:13:08.349 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-31T12:13:08.349 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-31T12:13:08.371 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.372 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-31T12:13:08.433 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-31T12:13:08.497 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.497 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-08-31T12:13:08.560 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.561 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-31T12:13:08.624 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-31T12:13:08.689 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-31T12:13:08.752 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:08.753 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-31T12:13:08.816 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:08.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-31T12:13:08.830 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:08.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-31T12:13:08.882 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:08.882 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-31T12:13:08.935 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:08.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-08-31T12:13:08.990 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:08.990 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-31T12:13:09.043 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:09.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-31T12:13:09.099 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:09.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-31T12:13:09.154 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:09.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-31T12:13:09.207 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:09.207 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-31T12:13:09.216 INFO:tasks.ceph:Adding keys to all mons... 2024-08-31T12:13:09.217 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-31T12:13:09.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-31T12:13:09.274 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNm2Ss9GBAA9xTMNpallKrRC4rN8XPKfA== 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNmbBB0IhAAiqucQqEvCRTp0mZrsDXAXQ== 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNmCeaCKhAAF4uW8/yyeUMv9z/BK6GOVA== 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.e] 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNmdIlrMhAAwUYox08AKOKePfKFR6z5pA== 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-08-31T12:13:09.275 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC3CNNmuSuYARAAkFS70WuFG6G4LcmLPMkbJg== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC6CNNmfBKCFxAAel/QG7dDtZDiqJ/umSpygQ== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC9CNNmMFRZLhAA2kdta/b5P4TMEDfi5aPZxA== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDBCNNmin+5CRAAdvIvDR7i+6gQz8sBEJqtiw== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNmg+n5HBAAc+qaQUOp6tvJI81qgNXAwg== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCzCNNm2xaDOBAAYtC3b2PKxw5AGdI5U2e5RQ== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC0CNNmCeWyBBAAlC9E7MTB6FhCTSTNm07ayw== 2024-08-31T12:13:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.f] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC0CNNmpD0rDBAAYcbVJe+EAM4MLrXVq8s0Cg== 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDHCNNmjweQFhAAMLNDCjhS/OZ+Vly3+FsDAQ== 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDKCNNmQLp9JxAAOMKOC8YsSUSqRBNzD3WqZg== 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDNCNNm/G2bNxAATjG2IGDDKK6I3mTKKvLllg== 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRCNNm5esTDBAAknJUt+ioyMKrl0aEIkl6pg== 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-08-31T12:13:09.277 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC0CNNmRNJuEBAAWxdEiRg44gzDnXNo6vBd0w== 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNm2Ss9GBAA9xTMNpallKrRC4rN8XPKfA== 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNmbBB0IhAAiqucQqEvCRTp0mZrsDXAXQ== 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNmCeaCKhAAF4uW8/yyeUMv9z/BK6GOVA== 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e] 2024-08-31T12:13:09.279 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNmdIlrMhAAwUYox08AKOKePfKFR6z5pA== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC3CNNmuSuYARAAkFS70WuFG6G4LcmLPMkbJg== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC6CNNmfBKCFxAAel/QG7dDtZDiqJ/umSpygQ== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC9CNNmMFRZLhAA2kdta/b5P4TMEDfi5aPZxA== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDBCNNmin+5CRAAdvIvDR7i+6gQz8sBEJqtiw== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNmg+n5HBAAc+qaQUOp6tvJI81qgNXAwg== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCzCNNm2xaDOBAAYtC3b2PKxw5AGdI5U2e5RQ== 2024-08-31T12:13:09.280 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC0CNNmCeWyBBAAlC9E7MTB6FhCTSTNm07ayw== 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f] 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC0CNNmpD0rDBAAYcbVJe+EAM4MLrXVq8s0Cg== 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDHCNNmjweQFhAAMLNDCjhS/OZ+Vly3+FsDAQ== 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDKCNNmQLp9JxAAOMKOC8YsSUSqRBNzD3WqZg== 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDNCNNm/G2bNxAATjG2IGDDKK6I3mTKKvLllg== 2024-08-31T12:13:09.281 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-08-31T12:13:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDRCNNm5esTDBAAknJUt+ioyMKrl0aEIkl6pg== 2024-08-31T12:13:09.282 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-08-31T12:13:09.282 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC0CNNmRNJuEBAAWxdEiRg44gzDnXNo6vBd0w== 2024-08-31T12:13:09.282 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T12:13:09.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T12:13:09.408 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.487 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.564 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:09.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.717 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.720 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:09.934 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T12:13:09.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T12:13:10.005 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.078 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T12:13:10.229 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T12:13:10.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-31T12:13:10.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-31T12:13:10.593 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-31T12:13:10.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-31T12:13:10.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T12:13:10.734 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-31T12:13:10.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-31T12:13:10.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T12:13:10.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-31T12:13:10.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-31T12:13:10.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T12:13:11.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-31T12:13:11.097 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:13:11.100 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-31T12:13:11.147 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-31T12:13:11.147 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-31T12:13:11.147 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-31T12:13:11.151 INFO:tasks.ceph.mon.a:Started 2024-08-31T12:13:11.151 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-31T12:13:11.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-31T12:13:11.193 INFO:tasks.ceph.mon.b:Started 2024-08-31T12:13:11.193 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-31T12:13:11.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-31T12:13:11.195 INFO:tasks.ceph.mon.c:Started 2024-08-31T12:13:11.195 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-31T12:13:11.195 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-31T12:13:11.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-31T12:13:11.199 INFO:tasks.ceph.mgr.y:Started 2024-08-31T12:13:11.199 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-31T12:13:11.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-31T12:13:11.201 INFO:tasks.ceph.mgr.x:Started 2024-08-31T12:13:11.202 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-08-31T12:13:11.202 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-08-31T12:13:11.206 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-08-31T12:13:11.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set client debug_client 20 2024-08-31T12:13:11.252 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-08-31T12:13:11.252 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set client debug_ms 1 2024-08-31T12:13:11.300 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-08-31T12:13:11.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-08-31T12:13:11.352 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-08-31T12:13:11.352 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-08-31T12:13:11.399 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-08-31T12:13:11.399 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-08-31T12:13:11.447 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-08-31T12:13:11.447 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-08-31T12:13:11.491 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-08-31T12:13:11.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-08-31T12:13:11.536 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T12:13:11.536 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T12:13:11.583 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-08-31T12:13:11.583 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-08-31T12:13:11.632 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-08-31T12:13:11.632 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-08-31T12:13:11.679 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-08-31T12:13:11.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-08-31T12:13:11.723 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-08-31T12:13:11.723 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-08-31T12:13:11.771 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-08-31T12:13:11.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-08-31T12:13:11.815 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-08-31T12:13:11.815 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-08-31T12:13:11.863 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-08-31T12:13:11.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-08-31T12:13:11.907 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = True 2024-08-31T12:13:11.907 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds mds_dir_prefetch True 2024-08-31T12:13:11.951 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-08-31T12:13:11.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-08-31T12:13:11.995 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T12:13:11.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-08-31T12:13:12.039 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T12:13:12.039 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-08-31T12:13:12.083 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-08-31T12:13:12.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-08-31T12:13:12.127 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T12:13:12.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T12:13:12.171 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-08-31T12:13:12.171 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-08-31T12:13:12.215 DEBUG:tasks.ceph:set 23 configs 2024-08-31T12:13:12.215 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.170+0000 7f1dd6400640 1 -- 172.21.15.164:0/754031936 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1da40050f0 con 0x7f1db80039c0 2024-08-31T12:13:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.174+0000 7fc0b1400640 1 -- 172.21.15.164:0/2970056554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090004810 msgr2=0x7fc0ac0cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.174+0000 7fc0b1400640 1 --2- 172.21.15.164:0/2970056554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090004810 0x7fc0ac0cd3d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc098004e00 tx=0x7fc098013820 comp rx=0 tx=0).stop 2024-08-31T12:13:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 -- 172.21.15.164:0/2970056554 shutdown_connections 2024-08-31T12:13:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 --2- 172.21.15.164:0/2970056554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0ac06cc30 0x7fc0ac1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 --2- 172.21.15.164:0/2970056554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090004810 0x7fc0ac0cd3d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 --2- 172.21.15.164:0/2970056554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0900039c0 0x7fc0ac143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 -- 172.21.15.164:0/2970056554 >> 172.21.15.164:0/2970056554 conn(0x7fc0ac0ca9c0 msgr2=0x7fc0ac0765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 -- 172.21.15.164:0/2970056554 shutdown_connections 2024-08-31T12:13:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7fc0b1400640 1 -- 172.21.15.164:0/2970056554 wait complete. 2024-08-31T12:13:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.178+0000 7f002a000640 1 -- 172.21.15.164:0/1058153769 <== mon.0 v2:172.21.15.164:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f001c030030 con 0x7f00180039c0 2024-08-31T12:13:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.186+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f491c0050f0 con 0x7f492800a100 2024-08-31T12:13:22.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.190+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4fe8005110 con 0x7f4ff80099c0 2024-08-31T12:13:22.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7f7fac0050f0 con 0x7f7fbc003a40 2024-08-31T12:13:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f3398153790 con 0x7f339814f490 2024-08-31T12:13:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 -- 172.21.15.164:0/1058153769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00180039c0 msgr2=0x7f00341ee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 --2- 172.21.15.164:0/1058153769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00180039c0 0x7f00341ee4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f001c006b30 tx=0x7f001c013820 comp rx=0 tx=0).stop 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 -- 172.21.15.164:0/1058153769 shutdown_connections 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 --2- 172.21.15.164:0/1058153769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00341ed350 0x7f00341ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 --2- 172.21.15.164:0/1058153769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00180039c0 0x7f00341ee4c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 --2- 172.21.15.164:0/1058153769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00100066d0 0x7f00341ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 -- 172.21.15.164:0/1058153769 >> 172.21.15.164:0/1058153769 conn(0x7f00340ca9c0 msgr2=0x7f00341519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 -- 172.21.15.164:0/1058153769 shutdown_connections 2024-08-31T12:13:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f3872000640 1 -- 172.21.15.164:0/3938421792 <== mon.1 v2:172.21.15.184:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v14)=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f386c0cb480 con 0x7f38600039c0 2024-08-31T12:13:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.194+0000 7f0038e00640 1 -- 172.21.15.164:0/1058153769 wait complete. 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 -- 172.21.15.164:0/3938421792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38600039c0 msgr2=0x7f3878153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 --2- 172.21.15.164:0/3938421792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38600039c0 0x7f3878153260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f386c01c630 tx=0x7f3860005840 comp rx=0 tx=0).stop 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 -- 172.21.15.164:0/3938421792 shutdown_connections 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 --2- 172.21.15.164:0/3938421792 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3860005360 0x7f38781558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 --2- 172.21.15.164:0/3938421792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860004810 0x7f3878154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 --2- 172.21.15.164:0/3938421792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38600039c0 0x7f3878153260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 -- 172.21.15.164:0/3938421792 >> 172.21.15.164:0/3938421792 conn(0x7f38780ca9c0 msgr2=0x7f3878151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 -- 172.21.15.164:0/3938421792 shutdown_connections 2024-08-31T12:13:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.198+0000 7f3880800640 1 -- 172.21.15.164:0/3938421792 wait complete. 2024-08-31T12:13:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.202+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f14000050f0 con 0x7f1410005340 2024-08-31T12:13:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.202+0000 7fefa6a00640 1 -- 172.21.15.164:0/2928988240 <== mon.2 v2:172.21.15.184:3301/0 9 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7fefa0021d00 con 0x7fef9000a680 2024-08-31T12:13:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 -- 172.21.15.164:0/2928988240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9000a680 msgr2=0x7fefb0151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 --2- 172.21.15.164:0/2928988240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9000a680 0x7fefb0151010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefa00206d0 tx=0x7fefa00207c0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 -- 172.21.15.164:0/2928988240 shutdown_connections 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 --2- 172.21.15.164:0/2928988240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef94004ea0 0x7fefb0151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 --2- 172.21.15.164:0/2928988240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef940040e0 0x7fefb00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 --2- 172.21.15.164:0/2928988240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9000a680 0x7fefb0151010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 -- 172.21.15.164:0/2928988240 >> 172.21.15.164:0/2928988240 conn(0x7fefb006e3d0 msgr2=0x7fefb00705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 -- 172.21.15.164:0/2928988240 shutdown_connections 2024-08-31T12:13:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.206+0000 7fefb5400640 1 -- 172.21.15.164:0/2928988240 wait complete. 2024-08-31T12:13:22.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.210+0000 7f8d29600640 1 -- 172.21.15.164:0/2758408281 <== mon.0 v2:172.21.15.164:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f8d18005660 con 0x7f8d2c14ab10 2024-08-31T12:13:22.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.210+0000 7f1423e00640 1 -- 172.21.15.164:0/123906034 <== mon.2 v2:172.21.15.184:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f14240056a0 con 0x7f1410005340 2024-08-31T12:13:22.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7f493ea00640 1 -- 172.21.15.164:0/485466331 <== mon.2 v2:172.21.15.184:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f49380a9bb0 con 0x7f492800a100 2024-08-31T12:13:22.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.210+0000 7f7fcea00640 1 -- 172.21.15.164:0/2487864314 <== mon.0 v2:172.21.15.164:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f7fc40c29d0 con 0x7f7fbc003a40 2024-08-31T12:13:22.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7f500a000640 1 -- 172.21.15.164:0/3233929945 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f500c01c430 con 0x7f4ff80099c0 2024-08-31T12:13:22.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7fe986000640 1 -- 172.21.15.164:0/2145896811 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fe97c0b19a0 con 0x7fe9740040e0 2024-08-31T12:13:22.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7f3395600640 1 -- 172.21.15.164:0/767906256 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f3384006d70 con 0x7f339814f490 2024-08-31T12:13:22.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7f1dccc00640 1 -- 172.21.15.164:0/754031936 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f1dbc0276b0 con 0x7f1db80039c0 2024-08-31T12:13:22.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7feaa3e00640 1 -- 172.21.15.164:0/2646100788 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7feaa401a610 con 0x7feaac159a70 2024-08-31T12:13:22.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.214+0000 7feaa3e00640 1 -- 172.21.15.164:0/2646100788 <== mon.1 v2:172.21.15.184:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7feaa401a820 con 0x7feaac159a70 2024-08-31T12:13:22.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.218+0000 7f8d29600640 1 -- 172.21.15.164:0/2758408281 <== mon.0 v2:172.21.15.164:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v17)=0 v17) ==== 114+0+0 (secure 0 0 0) 0x7f8d18004960 con 0x7f8d2c14ab10 2024-08-31T12:13:22.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7f1423e00640 1 -- 172.21.15.164:0/123906034 <== mon.2 v2:172.21.15.184:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f14240058d0 con 0x7f1410005340 2024-08-31T12:13:22.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7f493ea00640 1 -- 172.21.15.164:0/485466331 <== mon.2 v2:172.21.15.184:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f4938003600 con 0x7f492800a100 2024-08-31T12:13:22.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7f7fcea00640 1 -- 172.21.15.164:0/2487864314 <== mon.0 v2:172.21.15.164:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7fc40c2d50 con 0x7f7fbc003a40 2024-08-31T12:13:22.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7f8d29600640 1 -- 172.21.15.164:0/2758408281 <== mon.0 v2:172.21.15.164:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f8d18004b80 con 0x7f8d2c14ab10 2024-08-31T12:13:22.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 -- 172.21.15.164:0/2646100788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaac159a70 msgr2=0x7feaac159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 --2- 172.21.15.164:0/2646100788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaac159a70 0x7feaac159e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feaac073190 tx=0x7feaa400c710 comp rx=0 tx=0).stop 2024-08-31T12:13:22.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7f500a000640 1 -- 172.21.15.164:0/3233929945 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f500c01c6f0 con 0x7f4ff80099c0 2024-08-31T12:13:22.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f3395600640 1 -- 172.21.15.164:0/767906256 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f33840b7a00 con 0x7f339814f490 2024-08-31T12:13:22.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7fe986000640 1 -- 172.21.15.164:0/2145896811 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fe97c0b1c40 con 0x7fe9740040e0 2024-08-31T12:13:22.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f1dccc00640 1 -- 172.21.15.164:0/754031936 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f1dbc0276b0 con 0x7f1db80039c0 2024-08-31T12:13:22.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 -- 172.21.15.164:0/2758408281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d2c14ab10 msgr2=0x7f8d2c0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 --2- 172.21.15.164:0/2758408281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d2c14ab10 0x7f8d2c0c6b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d180058d0 tx=0x7f8d18012b90 comp rx=0 tx=0).stop 2024-08-31T12:13:22.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 -- 172.21.15.164:0/2758408281 shutdown_connections 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 -- 172.21.15.164:0/2646100788 shutdown_connections 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 --2- 172.21.15.164:0/2646100788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaac159a70 0x7feaac159e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 --2- 172.21.15.164:0/2646100788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feaac14d1e0 0x7feaac0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 --2- 172.21.15.164:0/2646100788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8c00f560 0x7feaac15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 -- 172.21.15.164:0/2646100788 >> 172.21.15.164:0/2646100788 conn(0x7feaac071a90 msgr2=0x7feaac14d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 -- 172.21.15.164:0/2646100788 shutdown_connections 2024-08-31T12:13:22.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.222+0000 7feab1a00640 1 -- 172.21.15.164:0/2646100788 wait complete. 2024-08-31T12:13:22.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 --2- 172.21.15.164:0/2758408281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d2c0cabd0 0x7f8d2c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 --2- 172.21.15.164:0/2758408281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d2c14ab10 0x7f8d2c0c6b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 --2- 172.21.15.164:0/2758408281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d0c006750 0x7f8d2c1f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 -- 172.21.15.164:0/2758408281 >> 172.21.15.164:0/2758408281 conn(0x7f8d2c06dd40 msgr2=0x7f8d2c14bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 -- 172.21.15.164:0/2758408281 shutdown_connections 2024-08-31T12:13:22.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.226+0000 7f8d34400640 1 -- 172.21.15.164:0/2758408281 wait complete. 2024-08-31T12:13:22.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.238+0000 7fe986000640 1 -- 172.21.15.164:0/2145896811 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7fe97c0ca020 con 0x7fe9740040e0 2024-08-31T12:13:22.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 -- 172.21.15.164:0/2145896811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9740040e0 msgr2=0x7fe990154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 --2- 172.21.15.164:0/2145896811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9740040e0 0x7fe990154300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe97c006000 tx=0x7fe97c01cb50 comp rx=0 tx=0).stop 2024-08-31T12:13:22.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 -- 172.21.15.164:0/2145896811 shutdown_connections 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 --2- 172.21.15.164:0/2145896811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe974004ea0 0x7fe9901f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 --2- 172.21.15.164:0/2145896811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9740040e0 0x7fe990154300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 --2- 172.21.15.164:0/2145896811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe970008e60 0x7fe9901fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 -- 172.21.15.164:0/2145896811 >> 172.21.15.164:0/2145896811 conn(0x7fe9900ca9c0 msgr2=0x7fe990152490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 -- 172.21.15.164:0/2145896811 shutdown_connections 2024-08-31T12:13:22.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.242+0000 7fe995000640 1 -- 172.21.15.164:0/2145896811 wait complete. 2024-08-31T12:13:22.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dccc00640 1 -- 172.21.15.164:0/754031936 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f1dbc01da70 con 0x7f1db80039c0 2024-08-31T12:13:22.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 -- 172.21.15.164:0/754031936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1db80039c0 msgr2=0x7f1dd0146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 --2- 172.21.15.164:0/754031936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1db80039c0 0x7f1dd0146c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc004d20 tx=0x7f1dbc0147c0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 -- 172.21.15.164:0/754031936 shutdown_connections 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 --2- 172.21.15.164:0/754031936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1db8004da0 0x7f1dd01471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 --2- 172.21.15.164:0/754031936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1db80039c0 0x7f1dd0146c70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 --2- 172.21.15.164:0/754031936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db000dd60 0x7f1dd00c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.246+0000 7f1dc2000640 1 -- 172.21.15.164:0/754031936 >> 172.21.15.164:0/754031936 conn(0x7f1dd006fd20 msgr2=0x7f1dd00c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.250+0000 7f1dc2000640 1 -- 172.21.15.164:0/754031936 shutdown_connections 2024-08-31T12:13:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.250+0000 7f1dc2000640 1 -- 172.21.15.164:0/754031936 wait complete. 2024-08-31T12:13:22.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.250+0000 7f7fcea00640 1 -- 172.21.15.164:0/2487864314 <== mon.0 v2:172.21.15.164:3300/0 11 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f7fc40047b0 con 0x7f7fbc003a40 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fbc003a40 msgr2=0x7f7fd8149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 --2- 172.21.15.164:0/2487864314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fbc003a40 0x7f7fd8149f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4021720 tx=0x7f7fbc005840 comp rx=0 tx=0).stop 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 shutdown_connections 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 --2- 172.21.15.164:0/2487864314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fbc004f50 0x7f7fd814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 --2- 172.21.15.164:0/2487864314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fbc003a40 0x7f7fd8149f00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 --2- 172.21.15.164:0/2487864314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb800a120 0x7f7fd80cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 >> 172.21.15.164:0/2487864314 conn(0x7f7fd80ca3a0 msgr2=0x7f7fd814afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 shutdown_connections 2024-08-31T12:13:22.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.254+0000 7f7fd7e00640 1 -- 172.21.15.164:0/2487864314 wait complete. 2024-08-31T12:13:22.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.266+0000 7f493ea00640 1 -- 172.21.15.164:0/485466331 <== mon.2 v2:172.21.15.184:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v21)=0 v21) ==== 117+0+0 (secure 0 0 0) 0x7f49380ae020 con 0x7f492800a100 2024-08-31T12:13:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f492800a100 msgr2=0x7f4948143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 --2- 172.21.15.164:0/485466331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f492800a100 0x7f4948143ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f493809a2a0 tx=0x7f492c005840 comp rx=0 tx=0).stop 2024-08-31T12:13:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 shutdown_connections 2024-08-31T12:13:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 --2- 172.21.15.164:0/485466331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f492c004810 0x7f49481522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 --2- 172.21.15.164:0/485466331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492c0039c0 0x7f4948146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 --2- 172.21.15.164:0/485466331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f492800a100 0x7f4948143ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 >> 172.21.15.164:0/485466331 conn(0x7f494806dd40 msgr2=0x7f49481538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 shutdown_connections 2024-08-31T12:13:22.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f494da00640 1 -- 172.21.15.164:0/485466331 wait complete. 2024-08-31T12:13:22.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f500a000640 1 -- 172.21.15.164:0/3233929945 <== mon.1 v2:172.21.15.184:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f500c01c920 con 0x7f4ff80099c0 2024-08-31T12:13:22.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f500a000640 1 -- 172.21.15.164:0/3233929945 <== mon.1 v2:172.21.15.184:3300/0 12 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7f500c01cd50 con 0x7f4ff80099c0 2024-08-31T12:13:22.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f3395600640 1 -- 172.21.15.164:0/767906256 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33840c09e0 con 0x7f339814f490 2024-08-31T12:13:22.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.274+0000 7f1423e00640 1 -- 172.21.15.164:0/123906034 <== mon.2 v2:172.21.15.184:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14240b0420 con 0x7f1410005340 2024-08-31T12:13:22.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff80099c0 msgr2=0x7f501014b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 --2- 172.21.15.164:0/3233929945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff80099c0 0x7f501014b300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5010074420 tx=0x7f500c011800 comp rx=0 tx=0).stop 2024-08-31T12:13:22.279 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.280 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.280 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 shutdown_connections 2024-08-31T12:13:22.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 --2- 172.21.15.164:0/3233929945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff80099c0 0x7f501014b300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 --2- 172.21.15.164:0/3233929945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff8004810 0x7f50101f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 --2- 172.21.15.164:0/3233929945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff8003a40 0x7f501014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 >> 172.21.15.164:0/3233929945 conn(0x7f50100ca9c0 msgr2=0x7f5010071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 shutdown_connections 2024-08-31T12:13:22.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.278+0000 7f5018800640 1 -- 172.21.15.164:0/3233929945 wait complete. 2024-08-31T12:13:22.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.282+0000 7f1423e00640 1 -- 172.21.15.164:0/123906034 <== mon.2 v2:172.21.15.184:3301/0 12 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f14240b06b0 con 0x7f1410005340 2024-08-31T12:13:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.286+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1410005340 msgr2=0x7f142c153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.286+0000 7f1431400640 1 --2- 172.21.15.164:0/123906034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1410005340 0x7f142c153530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1424000f90 tx=0x7f1410005840 comp rx=0 tx=0).stop 2024-08-31T12:13:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 shutdown_connections 2024-08-31T12:13:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 --2- 172.21.15.164:0/123906034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1410005340 0x7f142c153530 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 --2- 172.21.15.164:0/123906034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1410004810 0x7f142c1f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 --2- 172.21.15.164:0/123906034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14100039c0 0x7f142c1ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 >> 172.21.15.164:0/123906034 conn(0x7f142c072750 msgr2=0x7f142c15b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 shutdown_connections 2024-08-31T12:13:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f1431400640 1 -- 172.21.15.164:0/123906034 wait complete. 2024-08-31T12:13:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f3395600640 1 -- 172.21.15.164:0/767906256 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f33840c0df0 con 0x7f339814f490 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339814f490 msgr2=0x7f339806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 --2- 172.21.15.164:0/767906256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339814f490 0x7f339806e390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33840ae000 tx=0x7f3384018e80 comp rx=0 tx=0).stop 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 shutdown_connections 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 --2- 172.21.15.164:0/767906256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f339814ffb0 0x7f33981503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 --2- 172.21.15.164:0/767906256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339814f490 0x7f339806e390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 --2- 172.21.15.164:0/767906256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f337800f700 0x7f33981ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 >> 172.21.15.164:0/767906256 conn(0x7f3398071a70 msgr2=0x7f33980cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 shutdown_connections 2024-08-31T12:13:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.290+0000 7f339fe00640 1 -- 172.21.15.164:0/767906256 wait complete. 2024-08-31T12:13:22.314 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.314 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.314 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.315 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.318 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'True'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.320 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.320 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.324 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi164') 2024-08-31T12:13:22.324 INFO:tasks.ceph:Setting crush tunables to default 2024-08-31T12:13:22.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd crush tunables default 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- 172.21.15.164:0/2439538521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2104004810 msgr2=0x7f2104004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 --2- 172.21.15.164:0/2439538521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2104004810 0x7f2104004c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f210c0016f0 tx=0x7f210c01c750 comp rx=0 tx=0).stop 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- 172.21.15.164:0/2439538521 shutdown_connections 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 --2- 172.21.15.164:0/2439538521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2104004810 0x7f2104004c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- 172.21.15.164:0/2439538521 >> 172.21.15.164:0/2439538521 conn(0x7f2120073e80 msgr2=0x7f2120074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- 172.21.15.164:0/2439538521 shutdown_connections 2024-08-31T12:13:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- 172.21.15.164:0/2439538521 wait complete. 2024-08-31T12:13:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 Processor -- start 2024-08-31T12:13:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.518+0000 7f2124e00640 1 -- start start 2024-08-31T12:13:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2104004810 0x7f21201f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21200cc660 0x7f21201481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2120072450 con 0x7f21200cca70 2024-08-31T12:13:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2120159780 con 0x7f21200cc660 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f212014f600 con 0x7f2104004810 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35590/0 (socket says 172.21.15.164:35590) 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 -- 172.21.15.164:0/3412191156 learned_addr learned my addr 172.21.15.164:0/3412191156 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211d400640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21200cc660 0x7f21201481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211de00640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2104004810 0x7f21201f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 -- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2104004810 msgr2=0x7f21201f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2104004810 0x7f21201f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 -- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21200cc660 msgr2=0x7f21201481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21200cc660 0x7f21201481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 -- 172.21.15.164:0/3412191156 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21201f5ff0 con 0x7f21200cca70 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f211e800640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2120073be0 tx=0x7f211800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211801e070 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f211800fe50 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118009a90 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201f8740 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201584b0 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2118021070 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21180239c0 con 0x7f21200cca70 2024-08-31T12:13:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.522+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21200749a0 con 0x7f21200cca70 2024-08-31T12:13:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.526+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2118028020 con 0x7f21200cca70 2024-08-31T12:13:22.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.590+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2120148c30 con 0x7f21200cca70 2024-08-31T12:13:22.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2116000640 1 -- 172.21.15.164:0/3412191156 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2118023440 con 0x7f21200cca70 2024-08-31T12:13:22.595 INFO:teuthology.orchestra.run.smithi164.stderr:adjusted tunables profile to default 2024-08-31T12:13:22.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 msgr2=0x7f21201486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:22.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2120073be0 tx=0x7f211800f790 comp rx=0 tx=0).stop 2024-08-31T12:13:22.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 shutdown_connections 2024-08-31T12:13:22.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21200cca70 0x7f21201486f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21200cc660 0x7f21201481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 --2- 172.21.15.164:0/3412191156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2104004810 0x7f21201f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:22.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 >> 172.21.15.164:0/3412191156 conn(0x7f2120073e80 msgr2=0x7f2120157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:22.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 shutdown_connections 2024-08-31T12:13:22.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:22.594+0000 7f2124e00640 1 -- 172.21.15.164:0/3412191156 wait complete. 2024-08-31T12:13:22.616 INFO:tasks.ceph:check_enable_crimson: False 2024-08-31T12:13:22.616 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-31T12:13:22.616 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:22.616 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-31T12:13:22.637 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:22.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-31T12:13:22.701 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:22.701 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-31T12:13:22.760 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:13:22.760 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-31T12:13:22.820 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:22.820 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-31T12:13:22.832 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:22.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-31T12:13:22.887 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:22.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-31T12:13:22.938 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-08-31T12:13:22.938 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-31T12:13:22.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new c2135650-6ddb-4dd6-a43b-8d9d05af38e5 0 2024-08-31T12:13:23.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 -- 172.21.15.184:0/1242021840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 msgr2=0x7f6e00074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 --2- 172.21.15.184:0/1242021840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e00074b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e000c4850 tx=0x7f6df401c8c0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 -- 172.21.15.184:0/1242021840 shutdown_connections 2024-08-31T12:13:23.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 --2- 172.21.15.184:0/1242021840 >> v2:172.21.15.164:3300/0 conn(0x7f6e00151c90 0x7f6e00073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 --2- 172.21.15.184:0/1242021840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e00074b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 -- 172.21.15.184:0/1242021840 >> 172.21.15.184:0/1242021840 conn(0x7f6e00071970 msgr2=0x7f6e00071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 -- 172.21.15.184:0/1242021840 shutdown_connections 2024-08-31T12:13:23.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.184+0000 7f6e05922640 1 -- 172.21.15.184:0/1242021840 wait complete. 2024-08-31T12:13:23.188 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 Processor -- start 2024-08-31T12:13:23.188 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- start start 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 0x7f6e000c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e001564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 0x7f6e00146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6e001658e0 con 0x7f6e000c5490 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6e00165760 con 0x7f6e000c7f80 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6e00165a60 con 0x7f6e00151c90 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dff7fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 0x7f6e00146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e001564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dff7fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 0x7f6e00146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:43272/0 (socket says 172.21.15.184:43272) 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dff7fe640 1 -- 172.21.15.184:0/113464607 learned_addr learned my addr 172.21.15.184:0/113464607 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfeffd640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 0x7f6e000c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 -- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 msgr2=0x7f6e00146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 0x7f6e00146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 -- 172.21.15.184:0/113464607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 msgr2=0x7f6e000c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 0x7f6e000c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 -- 172.21.15.184:0/113464607 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e00163280 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfeffd640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 0x7f6e000c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6dfe7fc640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e001564c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e000c7090 tx=0x7f6df40a57a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40bd070 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6df4004430 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e000ca7d0 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40b2040 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e00162cc0 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6df4003860 con 0x7f6e000c7f80 2024-08-31T12:13:23.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.188+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6df40ada70 con 0x7f6e000c7f80 2024-08-31T12:13:23.193 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.192+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e000ca5c0 con 0x7f6e000c7f80 2024-08-31T12:13:23.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.192+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6df40164b0 con 0x7f6e000c7f80 2024-08-31T12:13:23.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.264+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c2135650-6ddb-4dd6-a43b-8d9d05af38e5", "id": 0} v 0) -- 0x7f6e00074b80 con 0x7f6e000c7f80 2024-08-31T12:13:23.272 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6de7fff640 1 -- 172.21.15.184:0/113464607 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2135650-6ddb-4dd6-a43b-8d9d05af38e5", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6df40adcc0 con 0x7f6e000c7f80 2024-08-31T12:13:23.272 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 msgr2=0x7f6e001564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e001564c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e000c7090 tx=0x7f6df40a57a0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 shutdown_connections 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e00151c90 0x7f6e00146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e000c7f80 0x7f6e001564c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 --2- 172.21.15.184:0/113464607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e000c5490 0x7f6e000c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 >> 172.21.15.184:0/113464607 conn(0x7f6e00071970 msgr2=0x7f6e00068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 shutdown_connections 2024-08-31T12:13:23.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.272+0000 7f6e05922640 1 -- 172.21.15.184:0/113464607 wait complete. 2024-08-31T12:13:23.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 12a93725-8483-4772-8eb2-9fb1f1318ca9 1 2024-08-31T12:13:23.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 -- 172.21.15.184:0/2784987402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700cb2a0 msgr2=0x7f4f700c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/2784987402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700cb2a0 0x7f4f700c9f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f700b3690 tx=0x7f4f5801c8c0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 -- 172.21.15.184:0/2784987402 shutdown_connections 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/2784987402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700cb2a0 0x7f4f700c9f30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/2784987402 >> v2:172.21.15.164:3300/0 conn(0x7f4f70155d30 0x7f4f700cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 -- 172.21.15.184:0/2784987402 >> 172.21.15.184:0/2784987402 conn(0x7f4f70072210 msgr2=0x7f4f70072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 -- 172.21.15.184:0/2784987402 shutdown_connections 2024-08-31T12:13:23.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.436+0000 7f4f74b7f640 1 -- 172.21.15.184:0/2784987402 wait complete. 2024-08-31T12:13:23.440 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 Processor -- start 2024-08-31T12:13:23.440 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- start start 2024-08-31T12:13:23.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 0x7f4f7014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f700cb2a0 0x7f4f701487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 0x7f4f701495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70156140 con 0x7f4f700cb2a0 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700b43c0 con 0x7f4f700ca470 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4f701562c0 con 0x7f4f70155d30 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 0x7f4f7014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 0x7f4f7014b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52616/0 (socket says 172.21.15.184:52616) 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 0x7f4f701495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6e59c640 1 -- 172.21.15.184:0/3287356699 learned_addr learned my addr 172.21.15.184:0/3287356699 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f67fff640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f700cb2a0 0x7f4f701487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 -- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 msgr2=0x7f4f7014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 0x7f4f7014b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 -- 172.21.15.184:0/3287356699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f700cb2a0 msgr2=0x7f4f701487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f700cb2a0 0x7f4f701487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 -- 172.21.15.184:0/3287356699 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7014be30 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f6ed9d640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 0x7f4f701495c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800c680 tx=0x7f4f6800cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68003b80 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f68003d20 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f701f1db0 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68005330 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7014b0f0 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f680054d0 con 0x7f4f70155d30 2024-08-31T12:13:23.445 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.440+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4f680124b0 con 0x7f4f70155d30 2024-08-31T12:13:23.446 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.444+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f700c9f30 con 0x7f4f70155d30 2024-08-31T12:13:23.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.448+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4f6800a640 con 0x7f4f70155d30 2024-08-31T12:13:23.519 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.516+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "12a93725-8483-4772-8eb2-9fb1f1318ca9", "id": 1} v 0) -- 0x7f4f700c9ae0 con 0x7f4f70155d30 2024-08-31T12:13:23.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f66ffd640 1 -- 172.21.15.184:0/3287356699 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12a93725-8483-4772-8eb2-9fb1f1318ca9", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4f6800a820 con 0x7f4f70155d30 2024-08-31T12:13:23.524 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 msgr2=0x7f4f701495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 0x7f4f701495c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800c680 tx=0x7f4f6800cb40 comp rx=0 tx=0).stop 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 shutdown_connections 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f70155d30 0x7f4f701495c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f700cb2a0 0x7f4f701487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 --2- 172.21.15.184:0/3287356699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f700ca470 0x7f4f7014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 >> 172.21.15.184:0/3287356699 conn(0x7f4f70072210 msgr2=0x7f4f700c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 shutdown_connections 2024-08-31T12:13:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.524+0000 7f4f74b7f640 1 -- 172.21.15.184:0/3287356699 wait complete. 2024-08-31T12:13:23.543 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 4ef1de51-2d58-4039-a9dd-1cd168f6cc32 2 2024-08-31T12:13:23.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/920469270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc415bb10 msgr2=0x7ffbc415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/920469270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc415bb10 0x7ffbc415bf20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009900 tx=0x7ffbb801f0d0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/920469270 shutdown_connections 2024-08-31T12:13:23.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/920469270 >> v2:172.21.15.164:3300/0 conn(0x7ffbc40c7f80 0x7ffbc40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/920469270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc415bb10 0x7ffbc415bf20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/920469270 >> 172.21.15.184:0/920469270 conn(0x7ffbc4071970 msgr2=0x7ffbc4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/920469270 shutdown_connections 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/920469270 wait complete. 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 Processor -- start 2024-08-31T12:13:23.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- start start 2024-08-31T12:13:23.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 0x7ffbc415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4158df0 con 0x7ffbc415bb10 2024-08-31T12:13:23.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4158b50 con 0x7ffbc40c5d10 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbcb7ed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40c4a80 con 0x7ffbc40c7f80 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9589640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9589640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52624/0 (socket says 172.21.15.184:52624) 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:43294/0 (socket says 172.21.15.184:43294) 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9589640 1 -- 172.21.15.184:0/1611691898 learned_addr learned my addr 172.21.15.184:0/1611691898 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9d8a640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 0x7ffbc415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 -- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 msgr2=0x7ffbc40cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 -- 172.21.15.184:0/1611691898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 msgr2=0x7ffbc415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 0x7ffbc415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 -- 172.21.15.184:0/1611691898 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40cc160 con 0x7ffbc40c7f80 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9d8a640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 0x7ffbc415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:23.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc9589640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.696+0000 7ffbc8d88640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80af000 tx=0x7ffbb8005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80b5040 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbb8003910 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc40ccf50 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8003d60 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc4159860 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffbb80c0060 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ffbb80b98f0 con 0x7ffbc40c7f80 2024-08-31T12:13:23.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc41568d0 con 0x7ffbc40c7f80 2024-08-31T12:13:23.703 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.700+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ffbb8018c30 con 0x7ffbc40c7f80 2024-08-31T12:13:23.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.772+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ef1de51-2d58-4039-a9dd-1cd168f6cc32", "id": 2} v 0) -- 0x7ffbc415b720 con 0x7ffbc40c7f80 2024-08-31T12:13:23.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.776+0000 7ffbc1ffb640 1 -- 172.21.15.184:0/1611691898 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ef1de51-2d58-4039-a9dd-1cd168f6cc32", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ffbb80b94d0 con 0x7ffbc40c7f80 2024-08-31T12:13:23.779 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 msgr2=0x7ffbc406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80af000 tx=0x7ffbb8005de0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 shutdown_connections 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbc415bb10 0x7ffbc415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc40c7f80 0x7ffbc406d820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 --2- 172.21.15.184:0/1611691898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc40c5d10 0x7ffbc40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 >> 172.21.15.184:0/1611691898 conn(0x7ffbc4071970 msgr2=0x7ffbc41482a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 shutdown_connections 2024-08-31T12:13:23.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.780+0000 7ffbcb7ed640 1 -- 172.21.15.184:0/1611691898 wait complete. 2024-08-31T12:13:23.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 14543401-3751-44a4-8ff5-79479ad4d8f1 3 2024-08-31T12:13:23.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 -- 172.21.15.184:0/3283646585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c0c5490 msgr2=0x7f3c9c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3283646585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c0c5490 0x7f3c9c0c7f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06dc90 tx=0x7f3c9401cd80 comp rx=0 tx=0).stop 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 -- 172.21.15.184:0/3283646585 shutdown_connections 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3283646585 >> v2:172.21.15.164:3300/0 conn(0x7f3c9c073e80 0x7f3c9c074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3283646585 >> v2:172.21.15.184:3300/0 conn(0x7f3c9c074b80 0x7f3c9c151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3283646585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c0c5490 0x7f3c9c0c7f80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 -- 172.21.15.184:0/3283646585 >> 172.21.15.184:0/3283646585 conn(0x7f3c9c071970 msgr2=0x7f3c9c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 -- 172.21.15.184:0/3283646585 shutdown_connections 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 -- 172.21.15.184:0/3283646585 wait complete. 2024-08-31T12:13:23.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.944+0000 7f3ca3898640 1 Processor -- start 2024-08-31T12:13:23.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- start start 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c9c074b80 0x7f3c9c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c9c0c5490 0x7f3c9c1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c158190 con 0x7f3c9c074b80 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c158010 con 0x7f3c9c0c5490 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9c158310 con 0x7f3c9c073e80 2024-08-31T12:13:23.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:43312/0 (socket says 172.21.15.184:43312) 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1e35640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c9c0c5490 0x7f3c9c1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 -- 172.21.15.184:0/3889359759 learned_addr learned my addr 172.21.15.184:0/3889359759 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca0e33640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c9c074b80 0x7f3c9c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 -- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c9c0c5490 msgr2=0x7f3c9c1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c9c0c5490 0x7f3c9c1485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 -- 172.21.15.184:0/3889359759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c9c074b80 msgr2=0x7f3c9c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c9c074b80 0x7f3c9c1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 -- 172.21.15.184:0/3889359759 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c157550 con 0x7f3c9c073e80 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca1634640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f90 tx=0x7f3c940092c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c940bb070 con 0x7f3c9c073e80 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c94004d40 con 0x7f3c9c073e80 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c940b2040 con 0x7f3c9c073e80 2024-08-31T12:13:23.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c1447f0 con 0x7f3c9c073e80 2024-08-31T12:13:23.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9c14a1d0 con 0x7f3c9c073e80 2024-08-31T12:13:23.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c940be070 con 0x7f3c9c073e80 2024-08-31T12:13:23.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3c940054c0 con 0x7f3c9c073e80 2024-08-31T12:13:23.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.948+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9c158820 con 0x7f3c9c073e80 2024-08-31T12:13:23.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:23.952+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3c940c5070 con 0x7f3c9c073e80 2024-08-31T12:13:24.024 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.024+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "14543401-3751-44a4-8ff5-79479ad4d8f1", "id": 3} v 0) -- 0x7f3c9c14b200 con 0x7f3c9c073e80 2024-08-31T12:13:24.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.028+0000 7f3c91ffb640 1 -- 172.21.15.184:0/3889359759 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14543401-3751-44a4-8ff5-79479ad4d8f1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3c94016970 con 0x7f3c9c073e80 2024-08-31T12:13:24.031 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 msgr2=0x7f3c9c157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f90 tx=0x7f3c940092c0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 shutdown_connections 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c9c0c5490 0x7f3c9c1485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c9c074b80 0x7f3c9c1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 --2- 172.21.15.184:0/3889359759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9c073e80 0x7f3c9c157010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 >> 172.21.15.184:0/3889359759 conn(0x7f3c9c071970 msgr2=0x7f3c9c15b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 shutdown_connections 2024-08-31T12:13:24.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.032+0000 7f3ca3898640 1 -- 172.21.15.184:0/3889359759 wait complete. 2024-08-31T12:13:24.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new edb46cb9-a605-49a8-99ad-3f817fe9935d 4 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 -- 172.21.15.184:0/321568074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a41522d0 msgr2=0x7fb3a416abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/321568074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a41522d0 0x7fb3a416abf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406fe50 tx=0x7fb39401f0f0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 -- 172.21.15.184:0/321568074 shutdown_connections 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/321568074 >> v2:172.21.15.184:3300/0 conn(0x7fb3a40736a0 0x7fb3a415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/321568074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a41522d0 0x7fb3a416abf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 -- 172.21.15.184:0/321568074 >> 172.21.15.184:0/321568074 conn(0x7fb3a40c99b0 msgr2=0x7fb3a40c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.211 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 -- 172.21.15.184:0/321568074 shutdown_connections 2024-08-31T12:13:24.211 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.208+0000 7fb3a95a9640 1 -- 172.21.15.184:0/321568074 wait complete. 2024-08-31T12:13:24.212 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 Processor -- start 2024-08-31T12:13:24.212 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 -- start start 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 0x7fb3a41fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 0x7fb3a4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3a41522d0 0x7fb3a414d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415bd20 con 0x7fb3a41522d0 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4070820 con 0x7fb3a4074ee0 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a95a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a415c000 con 0x7fb3a40736a0 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 0x7fb3a4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 0x7fb3a41fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 0x7fb3a4147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52680/0 (socket says 172.21.15.184:52680) 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a27fc640 1 -- 172.21.15.184:0/1253983948 learned_addr learned my addr 172.21.15.184:0/1253983948 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 -- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 msgr2=0x7fb3a4147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 0x7fb3a4147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 -- 172.21.15.184:0/1253983948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3a41522d0 msgr2=0x7fb3a414d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.215 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3a41522d0 0x7fb3a414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.216 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 -- 172.21.15.184:0/1253983948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a40c8860 con 0x7fb3a40736a0 2024-08-31T12:13:24.216 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.212+0000 7fb3a2ffd640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 0x7fb3a41fa4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c6c0 tx=0x7fb39c00cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:24.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003b80 con 0x7fb3a40736a0 2024-08-31T12:13:24.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb39c003d20 con 0x7fb3a40736a0 2024-08-31T12:13:24.218 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c005330 con 0x7fb3a40736a0 2024-08-31T12:13:24.218 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a41faa00 con 0x7fb3a40736a0 2024-08-31T12:13:24.218 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a415b730 con 0x7fb3a40736a0 2024-08-31T12:13:24.218 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb39c0054d0 con 0x7fb3a40736a0 2024-08-31T12:13:24.218 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb39c0129c0 con 0x7fb3a40736a0 2024-08-31T12:13:24.219 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.216+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40b2f00 con 0x7fb3a40736a0 2024-08-31T12:13:24.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.224+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb39c012c10 con 0x7fb3a40736a0 2024-08-31T12:13:24.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.332+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "edb46cb9-a605-49a8-99ad-3f817fe9935d", "id": 4} v 0) -- 0x7fb3a4074cc0 con 0x7fb3a40736a0 2024-08-31T12:13:24.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.336+0000 7fb38b7fe640 1 -- 172.21.15.184:0/1253983948 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edb46cb9-a605-49a8-99ad-3f817fe9935d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb39c012df0 con 0x7fb3a40736a0 2024-08-31T12:13:24.339 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 msgr2=0x7fb3a41fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 0x7fb3a41fa4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c6c0 tx=0x7fb39c00cb80 comp rx=0 tx=0).stop 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 shutdown_connections 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3a41522d0 0x7fb3a414d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3a4074ee0 0x7fb3a4147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 --2- 172.21.15.184:0/1253983948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3a40736a0 0x7fb3a41fa4c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 >> 172.21.15.184:0/1253983948 conn(0x7fb3a40c99b0 msgr2=0x7fb3a406f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 shutdown_connections 2024-08-31T12:13:24.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.340+0000 7fb3a95a9640 1 -- 172.21.15.184:0/1253983948 wait complete. 2024-08-31T12:13:24.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 2d1883af-14c8-47d3-9702-4c2f05b77c0a 5 2024-08-31T12:13:24.507 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 -- 172.21.15.184:0/3350039584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 msgr2=0x7f100815c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 --2- 172.21.15.184:0/3350039584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f100815c4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009900 tx=0x7f0ffc01c8e0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 -- 172.21.15.184:0/3350039584 shutdown_connections 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 --2- 172.21.15.184:0/3350039584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f100815c4a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 -- 172.21.15.184:0/3350039584 >> 172.21.15.184:0/3350039584 conn(0x7f1008074760 msgr2=0x7f1008074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 -- 172.21.15.184:0/3350039584 shutdown_connections 2024-08-31T12:13:24.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.504+0000 7f10102df640 1 -- 172.21.15.184:0/3350039584 wait complete. 2024-08-31T12:13:24.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.508+0000 7f10102df640 1 Processor -- start 2024-08-31T12:13:24.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.508+0000 7f10102df640 1 -- start start 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 0x7f100814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10080cc3b0 0x7f1008150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f10080ccbd0 con 0x7f10080cc3b0 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f100806e1d0 con 0x7f100806e6f0 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1008156030 con 0x7f10080b4f80 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100e07b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 0x7f100814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100e07b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52700/0 (socket says 172.21.15.184:52700) 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100e07b640 1 -- 172.21.15.184:0/2602779810 learned_addr learned my addr 172.21.15.184:0/2602779810 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100e87c640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10080cc3b0 0x7f1008150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 -- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 msgr2=0x7f10081f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 -- 172.21.15.184:0/2602779810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10080cc3b0 msgr2=0x7f1008150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10080cc3b0 0x7f1008150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 -- 172.21.15.184:0/2602779810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10081502d0 con 0x7f10080b4f80 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100e07b640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f100d87a640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 0x7f100814fd90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f10080ce5c0 tx=0x7f0ffc005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:24.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0be070 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ffc004330 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100814ecf0 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0b2040 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f100814f2b0 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ffc003840 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0ffc0add80 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.512+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10080ce040 con 0x7f10080b4f80 2024-08-31T12:13:24.516 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.516+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0ffc0164d0 con 0x7f10080b4f80 2024-08-31T12:13:24.555 INFO:tasks.ceph.mgr.x.smithi184.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-31T12:13:24.555 INFO:tasks.ceph.mgr.x.smithi184.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-31T12:13:24.555 INFO:tasks.ceph.mgr.x.smithi184.stderr: from numpy import show_config as show_numpy_config 2024-08-31T12:13:24.584 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.584+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d1883af-14c8-47d3-9702-4c2f05b77c0a", "id": 5} v 0) -- 0x7f10080c8170 con 0x7f10080b4f80 2024-08-31T12:13:24.590 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.588+0000 7f0ffaffd640 1 -- 172.21.15.184:0/2602779810 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d1883af-14c8-47d3-9702-4c2f05b77c0a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0ffc003bd0 con 0x7f10080b4f80 2024-08-31T12:13:24.590 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 msgr2=0x7f100814fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 0x7f100814fd90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f10080ce5c0 tx=0x7f0ffc005de0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 shutdown_connections 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10080cc3b0 0x7f1008150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10080b4f80 0x7f100814fd90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 --2- 172.21.15.184:0/2602779810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100806e6f0 0x7f10081f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 >> 172.21.15.184:0/2602779810 conn(0x7f1008074760 msgr2=0x7f10080b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 shutdown_connections 2024-08-31T12:13:24.593 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.592+0000 7f10102df640 1 -- 172.21.15.184:0/2602779810 wait complete. 2024-08-31T12:13:24.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new e289e257-cfc1-4bbc-ad1a-fae5f6349c22 6 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- 172.21.15.184:0/3631786988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40c9f30 msgr2=0x7f03d40ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 --2- 172.21.15.184:0/3631786988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40c9f30 0x7f03d40ca340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03d40b3690 tx=0x7f03c801c8c0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- 172.21.15.184:0/3631786988 shutdown_connections 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 --2- 172.21.15.184:0/3631786988 >> v2:172.21.15.164:3300/0 conn(0x7f03d40b38a0 0x7f03d40b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 --2- 172.21.15.184:0/3631786988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40c9f30 0x7f03d40ca340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- 172.21.15.184:0/3631786988 >> 172.21.15.184:0/3631786988 conn(0x7f03d4072210 msgr2=0x7f03d4072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- 172.21.15.184:0/3631786988 shutdown_connections 2024-08-31T12:13:24.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- 172.21.15.184:0/3631786988 wait complete. 2024-08-31T12:13:24.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 Processor -- start 2024-08-31T12:13:24.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.748+0000 7f03dae16640 1 -- start start 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d40c9f30 0x7f03d4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 0x7f03d4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f03d40c3030 con 0x7f03d40c9f30 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4156140 con 0x7f03d40b38a0 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f03d4150740 con 0x7f03d4155d30 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d8bb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 0x7f03d4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d8bb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52726/0 (socket says 172.21.15.184:52726) 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d8bb2640 1 -- 172.21.15.184:0/3166925081 learned_addr learned my addr 172.21.15.184:0/3166925081 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:24.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d3fff640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d40c9f30 0x7f03d4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 -- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 msgr2=0x7f03d4147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 -- 172.21.15.184:0/3166925081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d40c9f30 msgr2=0x7f03d4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d40c9f30 0x7f03d4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 -- 172.21.15.184:0/3166925081 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d4154940 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d8bb2640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d93b3640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 0x7f03d4140aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03d40732b0 tx=0x7f03cc00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc007d10 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03cc00f450 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d4153e90 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00f8a0 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d4150220 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03cc0183f0 con 0x7f03d4155d30 2024-08-31T12:13:24.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f03cc00ed60 con 0x7f03d4155d30 2024-08-31T12:13:24.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.752+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d40b4280 con 0x7f03d4155d30 2024-08-31T12:13:24.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.756+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03cc014070 con 0x7f03d4155d30 2024-08-31T12:13:24.825 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.824+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e289e257-cfc1-4bbc-ad1a-fae5f6349c22", "id": 6} v 0) -- 0x7f03d40c9730 con 0x7f03d4155d30 2024-08-31T12:13:24.833 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03d17fa640 1 -- 172.21.15.184:0/3166925081 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e289e257-cfc1-4bbc-ad1a-fae5f6349c22", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f03cc00fdd0 con 0x7f03d4155d30 2024-08-31T12:13:24.833 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 msgr2=0x7f03d4140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 0x7f03d4140aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03d40732b0 tx=0x7f03cc00cf10 comp rx=0 tx=0).stop 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 shutdown_connections 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03d4155d30 0x7f03d4140aa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d40c9f30 0x7f03d4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 --2- 172.21.15.184:0/3166925081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03d40b38a0 0x7f03d4147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 >> 172.21.15.184:0/3166925081 conn(0x7f03d4072210 msgr2=0x7f03d414a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 shutdown_connections 2024-08-31T12:13:24.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.832+0000 7f03dae16640 1 -- 172.21.15.184:0/3166925081 wait complete. 2024-08-31T12:13:24.852 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new a10b01a1-7e99-4616-baea-699c37eb9ddd 7 2024-08-31T12:13:24.997 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- 172.21.15.184:0/3255283033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 msgr2=0x7f065c0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:24.997 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 --2- 172.21.15.184:0/3255283033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0b3cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0654009c80 tx=0x7f065401cda0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.997 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- 172.21.15.184:0/3255283033 shutdown_connections 2024-08-31T12:13:24.997 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 --2- 172.21.15.184:0/3255283033 >> v2:172.21.15.184:3300/0 conn(0x7f065c0c9f30 0x7f065c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 --2- 172.21.15.184:0/3255283033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0b3cb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- 172.21.15.184:0/3255283033 >> 172.21.15.184:0/3255283033 conn(0x7f065c072210 msgr2=0x7f065c072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- 172.21.15.184:0/3255283033 shutdown_connections 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- 172.21.15.184:0/3255283033 wait complete. 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 Processor -- start 2024-08-31T12:13:24.998 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:24.996+0000 7f06612ae640 1 -- start start 2024-08-31T12:13:25.001 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.001 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f065c0c9f30 0x7f065c14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.001 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c155d30 0x7f065c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.001 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f065c0c3030 con 0x7f065c0c9f30 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f065c156140 con 0x7f065c155d30 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f065c1f6100 con 0x7f065c0b38a0 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:43364/0 (socket says 172.21.15.184:43364) 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 -- 172.21.15.184:0/3643748735 learned_addr learned my addr 172.21.15.184:0/3643748735 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065b7fe640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c155d30 0x7f065c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f0653fff640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f065c0c9f30 0x7f065c14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 -- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c155d30 msgr2=0x7f065c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c155d30 0x7f065c0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 -- 172.21.15.184:0/3643748735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f065c0c9f30 msgr2=0x7f065c14d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f065c0c9f30 0x7f065c14d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 -- 172.21.15.184:0/3643748735 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c0cdd50 con 0x7f065c0b38a0 2024-08-31T12:13:25.002 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f065affd640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c3f0 tx=0x7f064c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c0052d0 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f064c007020 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c0cbf20 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c007470 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c0cc4c0 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f064c0067e0 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f064c011bf0 con 0x7f065c0b38a0 2024-08-31T12:13:25.003 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.000+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c0ca340 con 0x7f065c0b38a0 2024-08-31T12:13:25.004 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.004+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f064c007610 con 0x7f065c0b38a0 2024-08-31T12:13:25.070 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.068+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a10b01a1-7e99-4616-baea-699c37eb9ddd", "id": 7} v 0) -- 0x7f065c0b3e40 con 0x7f065c0b38a0 2024-08-31T12:13:25.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06537fe640 1 -- 172.21.15.184:0/3643748735 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a10b01a1-7e99-4616-baea-699c37eb9ddd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f064c011e90 con 0x7f065c0b38a0 2024-08-31T12:13:25.080 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 msgr2=0x7f065c0cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c3f0 tx=0x7f064c00c8b0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 shutdown_connections 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c155d30 0x7f065c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f065c0c9f30 0x7f065c14d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 --2- 172.21.15.184:0/3643748735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f065c0b38a0 0x7f065c0cd810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 >> 172.21.15.184:0/3643748735 conn(0x7f065c072210 msgr2=0x7f065c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 shutdown_connections 2024-08-31T12:13:25.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-08-31T12:13:25.080+0000 7f06612ae640 1 -- 172.21.15.184:0/3643748735 wait complete. 2024-08-31T12:13:25.085 INFO:tasks.ceph.mgr.y.smithi164.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-31T12:13:25.085 INFO:tasks.ceph.mgr.y.smithi164.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-31T12:13:25.085 INFO:tasks.ceph.mgr.y.smithi164.stderr: from numpy import show_config as show_numpy_config 2024-08-31T12:13:25.099 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-31T12:13:25.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-31T12:13:25.103 INFO:tasks.ceph.osd.0:Started 2024-08-31T12:13:25.103 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-31T12:13:25.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-31T12:13:25.106 INFO:tasks.ceph.osd.1:Started 2024-08-31T12:13:25.106 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-31T12:13:25.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-31T12:13:25.109 INFO:tasks.ceph.osd.2:Started 2024-08-31T12:13:25.109 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-31T12:13:25.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-31T12:13:25.113 INFO:tasks.ceph.osd.3:Started 2024-08-31T12:13:25.113 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-31T12:13:25.113 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-31T12:13:25.115 INFO:tasks.ceph.osd.4:Started 2024-08-31T12:13:25.116 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-31T12:13:25.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-31T12:13:25.117 INFO:tasks.ceph.osd.5:Started 2024-08-31T12:13:25.118 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-31T12:13:25.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-31T12:13:25.120 INFO:tasks.ceph.osd.6:Started 2024-08-31T12:13:25.120 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-31T12:13:25.120 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-31T12:13:25.122 INFO:tasks.ceph.osd.7:Started 2024-08-31T12:13:25.123 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 -- 172.21.15.164:0/1976997491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2900 msgr2=0x7f0a1c1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 --2- 172.21.15.164:0/1976997491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c1520f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400a950 tx=0x7f0a0401dae0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 -- 172.21.15.164:0/1976997491 shutdown_connections 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 --2- 172.21.15.164:0/1976997491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c1520f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 -- 172.21.15.164:0/1976997491 >> 172.21.15.164:0/1976997491 conn(0x7f0a1c0ccf20 msgr2=0x7f0a1c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 -- 172.21.15.164:0/1976997491 shutdown_connections 2024-08-31T12:13:25.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.318+0000 7f0a21200640 1 -- 172.21.15.164:0/1976997491 wait complete. 2024-08-31T12:13:25.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 Processor -- start 2024-08-31T12:13:25.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- start start 2024-08-31T12:13:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 0x7f0a1c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c158980 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c158800 con 0x7f0a1c0b2900 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c165e80 con 0x7f0a1c0c8810 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35630/0 (socket says 172.21.15.164:35630) 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 -- 172.21.15.164:0/1786164104 learned_addr learned my addr 172.21.15.164:0/1786164104 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a19e00640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a1a800640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 0x7f0a1c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 -- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 msgr2=0x7f0a1c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 0x7f0a1c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 -- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a1c0b2900 msgr2=0x7f0a1c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 -- 172.21.15.164:0/1786164104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c0c6fb0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a1a800640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 0x7f0a1c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a13e00640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a040994e0 tx=0x7f0a04005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040b3040 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a04005320 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040046d0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c14fed0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.322+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c0c4850 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.326+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a04004870 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.326+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0a04003ba0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.326+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c1520f0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.326+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0a04017760 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a1c1565c0 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a12000640 1 -- 172.21.15.164:0/1786164104 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0a04003600 con 0x7f0a1c0b2fe0 2024-08-31T12:13:25.388 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:25.388 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:25.072710+0000","last_up_change":"0.000000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:25.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 msgr2=0x7f0a1c0c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a040994e0 tx=0x7f0a04005ca0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 shutdown_connections 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1c0c8810 0x7f0a1c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a1c0b2fe0 0x7f0a1c0c6a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 --2- 172.21.15.164:0/1786164104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a1c0b2900 0x7f0a1c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 >> 172.21.15.164:0/1786164104 conn(0x7f0a1c0ccf20 msgr2=0x7f0a1c14e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 shutdown_connections 2024-08-31T12:13:25.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:25.386+0000 7f0a21200640 1 -- 172.21.15.164:0/1786164104 wait complete. 2024-08-31T12:13:25.408 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-31T12:13:25.409 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-31T12:13:26.215 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:26.325 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-08-31T12:13:26.324+0000 7fabb0f5b7c0 -1 Falling back to public interface 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- 172.21.15.164:0/3787264601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 msgr2=0x7fe4180c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 --2- 172.21.15.164:0/3787264601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4180c8de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4180c8460 tx=0x7fe41001f580 comp rx=0 tx=0).stop 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- 172.21.15.164:0/3787264601 shutdown_connections 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 --2- 172.21.15.164:0/3787264601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4180c8de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 --2- 172.21.15.164:0/3787264601 >> v2:172.21.15.184:3300/0 conn(0x7fe4180c7540 0x7fe4180c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.363 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- 172.21.15.164:0/3787264601 >> 172.21.15.164:0/3787264601 conn(0x7fe418074920 msgr2=0x7fe4180720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:26.364 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- 172.21.15.164:0/3787264601 shutdown_connections 2024-08-31T12:13:26.364 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- 172.21.15.164:0/3787264601 wait complete. 2024-08-31T12:13:26.365 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 Processor -- start 2024-08-31T12:13:26.365 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.362+0000 7fe41e600640 1 -- start start 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4180c7540 0x7fe41814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4181551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe41815db90 con 0x7fe4180c89d0 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe41815d8b0 con 0x7fe41806dee0 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe4180c9320 con 0x7fe4180c7540 2024-08-31T12:13:26.367 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4181551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:26.368 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:26.368 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40fe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4180c7540 0x7fe41814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:26.368 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:35684/0 (socket says 172.21.15.164:35684) 2024-08-31T12:13:26.368 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 -- 172.21.15.164:0/2215357850 learned_addr learned my addr 172.21.15.164:0/2215357850 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 -- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4180c7540 msgr2=0x7fe41814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4180c7540 0x7fe41814d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 -- 172.21.15.164:0/2215357850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 msgr2=0x7fe4181551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4181551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 -- 172.21.15.164:0/2215357850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4181e5390 con 0x7fe41806dee0 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417e00640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4181551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:26.369 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe417400640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe40800c3c0 tx=0x7fe40800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe408017070 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4080053c0 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41815c730 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe408003860 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4180cbdd0 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe40801a070 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe408011d10 con 0x7fe41806dee0 2024-08-31T12:13:26.370 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.366+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4180cc1b0 con 0x7fe41806dee0 2024-08-31T12:13:26.372 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.370+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe4180cc1b0 con 0x7fe41806dee0 2024-08-31T12:13:26.431 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.430+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4181e3150 con 0x7fe41806dee0 2024-08-31T12:13:26.432 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.430+0000 7fe40f400640 1 -- 172.21.15.164:0/2215357850 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe408021020 con 0x7fe41806dee0 2024-08-31T12:13:26.433 INFO:teuthology.misc.health.smithi164.stdout: 2024-08-31T12:13:26.433 INFO:teuthology.misc.health.smithi164.stdout:{"epoch":10,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:25.072710+0000","last_up_change":"0.000000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.430+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 msgr2=0x7fe4181e4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.430+0000 7fe41e600640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe40800c3c0 tx=0x7fe40800c880 comp rx=0 tx=0).stop 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 shutdown_connections 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4180c89d0 0x7fe4181551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4180c7540 0x7fe41814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 --2- 172.21.15.164:0/2215357850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe41806dee0 0x7fe4181e4e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 >> 172.21.15.164:0/2215357850 conn(0x7fe418074920 msgr2=0x7fe418154810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 shutdown_connections 2024-08-31T12:13:26.434 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:26.434+0000 7fe41e600640 1 -- 172.21.15.164:0/2215357850 wait complete. 2024-08-31T12:13:26.450 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-31T12:13:26.633 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-08-31T12:13:26.632+0000 7f8b8a04e7c0 -1 Falling back to public interface 2024-08-31T12:13:26.883 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-08-31T12:13:26.882+0000 7f38bfb4a7c0 -1 Falling back to public interface 2024-08-31T12:13:26.903 INFO:tasks.ceph.osd.0.smithi164.stderr:2024-08-31T12:13:26.902+0000 7f0bb28707c0 -1 Falling back to public interface 2024-08-31T12:13:26.943 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-08-31T12:13:26.942+0000 7f06a413c7c0 -1 Falling back to public interface 2024-08-31T12:13:26.963 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-08-31T12:13:26.962+0000 7f80ed79b7c0 -1 Falling back to public interface 2024-08-31T12:13:27.006 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-08-31T12:13:27.004+0000 7f48946e17c0 -1 Falling back to public interface 2024-08-31T12:13:27.293 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-08-31T12:13:27.292+0000 7fbcaf3e07c0 -1 Falling back to public interface 2024-08-31T12:13:27.534 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-08-31T12:13:27.532+0000 7f7003db0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-31T12:13:30.464 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-08-31T12:13:30.464+0000 7fabb0f5b7c0 -1 osd.4 0 log_to_monitors true 2024-08-31T12:13:30.674 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-08-31T12:13:30.672+0000 7f8b8a04e7c0 -1 osd.5 0 log_to_monitors true 2024-08-31T12:13:31.095 INFO:tasks.ceph.osd.0.smithi164.stderr:2024-08-31T12:13:31.093+0000 7f0bb28707c0 -1 osd.0 0 log_to_monitors true 2024-08-31T12:13:31.173 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-08-31T12:13:31.172+0000 7f48946e17c0 -1 osd.7 0 log_to_monitors true 2024-08-31T12:13:31.287 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-08-31T12:13:31.285+0000 7f06a413c7c0 -1 osd.1 0 log_to_monitors true 2024-08-31T12:13:31.401 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-08-31T12:13:31.400+0000 7fbcaf3e07c0 -1 osd.6 0 log_to_monitors true 2024-08-31T12:13:31.463 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-08-31T12:13:31.461+0000 7f38bfb4a7c0 -1 osd.3 0 log_to_monitors true 2024-08-31T12:13:31.570 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-08-31T12:13:31.569+0000 7f80ed79b7c0 -1 osd.2 0 log_to_monitors true 2024-08-31T12:13:32.609 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-08-31T12:13:32.608+0000 7fabacf01640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T12:13:32.629 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-08-31T12:13:32.628+0000 7faba4cfe640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:33.212 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:13:33.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:13:33.258 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:33.478 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 -- 172.21.15.164:0/2061607925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c7880 msgr2=0x7ffb1c06e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:33.478 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 --2- 172.21.15.164:0/2061607925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c06e100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cece0 tx=0x7ffb0401c830 comp rx=0 tx=0).stop 2024-08-31T12:13:33.478 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 -- 172.21.15.164:0/2061607925 shutdown_connections 2024-08-31T12:13:33.478 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 --2- 172.21.15.164:0/2061607925 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.479 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 --2- 172.21.15.164:0/2061607925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c06e100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.479 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 --2- 172.21.15.164:0/2061607925 >> v2:172.21.15.184:3300/0 conn(0x7ffb1c0c9b10 0x7ffb1c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.479 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 -- 172.21.15.164:0/2061607925 >> 172.21.15.164:0/2061607925 conn(0x7ffb1c0721e0 msgr2=0x7ffb1c0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:33.479 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 -- 172.21.15.164:0/2061607925 shutdown_connections 2024-08-31T12:13:33.479 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.473+0000 7ffb23200640 1 -- 172.21.15.164:0/2061607925 wait complete. 2024-08-31T12:13:33.480 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.477+0000 7ffb23200640 1 Processor -- start 2024-08-31T12:13:33.480 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.477+0000 7ffb23200640 1 -- start start 2024-08-31T12:13:33.483 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:33.483 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:33.483 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:33.483 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0c9750 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0c40d0 con 0x7ffb1c0c7880 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0c98d0 con 0x7ffb1c06e640 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb13400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59122/0 (socket says 172.21.15.164:59122) 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 -- 172.21.15.164:0/1880824096 learned_addr learned my addr 172.21.15.164:0/1880824096 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb1be00640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 -- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 msgr2=0x7ffb1c0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 -- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 msgr2=0x7ffb1c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 -- 172.21.15.164:0/1880824096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c0b3d30 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.484 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb13400640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:33.485 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb1be00640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:33.485 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb21200640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400ea80 tx=0x7ffb1400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:33.485 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400cea0 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.485 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb14004b30 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.486 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14005020 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.486 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 -- 172.21.15.164:0/1880824096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c14d160 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.486 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.481+0000 7ffb23200640 1 -- 172.21.15.164:0/1880824096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c157e70 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.486 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.485+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c156460 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.491 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.489+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) ==== 95888+0+0 (secure 0 0 0) 0x7ffb140051c0 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.492 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.489+0000 7ffb18c00640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 0x7ffaf8074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:33.492 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.489+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7ffb140927b0 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.492 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.489+0000 7ffb1be00640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 0x7ffaf8074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:33.493 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.489+0000 7ffb1be00640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 0x7ffaf8074540 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009eb0 tx=0x7ffb0c0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:33.498 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.497+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ffb1405e8a0 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.706 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb1c0b3f00 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.706 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb18c00640 1 -- 172.21.15.164:0/1880824096 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7ffb140673a0 con 0x7ffb1c0c9b10 2024-08-31T12:13:33.707 INFO:teuthology.misc.health.smithi164.stdout: 2024-08-31T12:13:33.707 INFO:teuthology.misc.health.smithi164.stdout:{"epoch":13,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:32.653316+0000","last_up_change":"2024-08-31T12:13:32.653316+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 msgr2=0x7ffaf8074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 0x7ffaf8074540 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009eb0 tx=0x7ffb0c0091e0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 msgr2=0x7ffb1c0c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400ea80 tx=0x7ffb1400ef40 comp rx=0 tx=0).stop 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 shutdown_connections 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ffaf8072030 0x7ffaf8074540 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb1c0c9b10 0x7ffb1c0c6a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb1c0c7880 0x7ffb1c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.710 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 --2- 172.21.15.164:0/1880824096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1c06e640 0x7ffb1c0b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:33.711 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 >> 172.21.15.164:0/1880824096 conn(0x7ffb1c0721e0 msgr2=0x7ffb1c151eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:33.711 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 shutdown_connections 2024-08-31T12:13:33.711 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:33.705+0000 7ffb11600640 1 -- 172.21.15.164:0/1880824096 wait complete. 2024-08-31T12:13:33.730 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-08-31T12:13:34.457 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-08-31T12:13:34.456+0000 7f8b85ff4640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T12:13:34.466 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-08-31T12:13:34.464+0000 7fbcabb9b640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T12:13:34.490 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-08-31T12:13:34.488+0000 7f4890e9c640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T12:13:34.496 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-08-31T12:13:34.496+0000 7f8b7ddf1640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:34.496 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-08-31T12:13:34.496+0000 7fbca3183640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:34.512 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-08-31T12:13:34.512+0000 7f4888484640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:35.053 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-08-31T12:13:35.049+0000 7f38bb400640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T12:13:35.053 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-08-31T12:13:35.049+0000 7f38bb400640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T12:13:35.053 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-08-31T12:13:35.049+0000 7f069f000640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T12:13:35.076 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-08-31T12:13:35.073+0000 7f38b0a00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:35.091 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-08-31T12:13:35.089+0000 7f0695000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:35.093 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-08-31T12:13:35.089+0000 7f80e8600640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T12:13:35.131 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-08-31T12:13:35.129+0000 7f80de600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:35.139 INFO:tasks.ceph.osd.0.smithi164.stderr:2024-08-31T12:13:35.137+0000 7f0bae200640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T12:13:35.175 INFO:tasks.ceph.osd.0.smithi164.stderr:2024-08-31T12:13:35.173+0000 7f0ba3800640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:13:40.537 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:40.695 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- 172.21.15.164:0/1890751478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 msgr2=0x7f6a34074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:40.695 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/1890751478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a34074870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009900 tx=0x7f6a1c01f0d0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.695 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- 172.21.15.164:0/1890751478 shutdown_connections 2024-08-31T12:13:40.695 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/1890751478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a34074870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.696 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/1890751478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a34074db0 0x7f6a34158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.696 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- 172.21.15.164:0/1890751478 >> 172.21.15.164:0/1890751478 conn(0x7f6a34070e40 msgr2=0x7f6a34071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:40.696 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- 172.21.15.164:0/1890751478 shutdown_connections 2024-08-31T12:13:40.696 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- 172.21.15.164:0/1890751478 wait complete. 2024-08-31T12:13:40.697 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 Processor -- start 2024-08-31T12:13:40.697 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.693+0000 7f6a3ba00640 1 -- start start 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a34074db0 0x7f6a340c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a340c1b70 0x7f6a3414c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340c2dc0 con 0x7f6a341527f0 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340c30a0 con 0x7f6a34074db0 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a340cc350 con 0x7f6a340c1b70 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37152/0 (socket says 172.21.15.164:37152) 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 -- 172.21.15.164:0/4180933066 learned_addr learned my addr 172.21.15.164:0/4180933066 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:40.700 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a2be00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a340c1b70 0x7f6a3414c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39000640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a34074db0 0x7f6a340c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 -- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a340c1b70 msgr2=0x7f6a3414c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a340c1b70 0x7f6a3414c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 -- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a34074db0 msgr2=0x7f6a340c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a34074db0 0x7f6a340c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 -- 172.21.15.164:0/4180933066 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a340b2dc0 con 0x7f6a341527f0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a39a00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00e970 tx=0x7f6a2c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c004d30 con 0x7f6a341527f0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a2c00cb20 con 0x7f6a341527f0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c005020 con 0x7f6a341527f0 2024-08-31T12:13:40.701 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a340c7840 con 0x7f6a341527f0 2024-08-31T12:13:40.702 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341f3c30 con 0x7f6a341527f0 2024-08-31T12:13:40.702 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.697+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a34074870 con 0x7f6a341527f0 2024-08-31T12:13:40.702 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.701+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) ==== 95888+0+0 (secure 0 0 0) 0x7f6a2c0051c0 con 0x7f6a341527f0 2024-08-31T12:13:40.704 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.701+0000 7f6a31600640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 0x7f6a10074570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:40.704 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.701+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6a2c0934e0 con 0x7f6a341527f0 2024-08-31T12:13:40.704 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.701+0000 7f6a39000640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 0x7f6a10074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:40.705 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.701+0000 7f6a39000640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 0x7f6a10074570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f70 tx=0x7f6a24009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:40.707 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.705+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6a2c016030 con 0x7f6a341527f0 2024-08-31T12:13:40.873 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.869+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a34073f40 con 0x7f6a341527f0 2024-08-31T12:13:40.874 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a31600640 1 -- 172.21.15.164:0/4180933066 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12956 (secure 0 0 0) 0x7f6a2c05f240 con 0x7f6a341527f0 2024-08-31T12:13:40.875 INFO:teuthology.misc.health.smithi164.stdout: 2024-08-31T12:13:40.875 INFO:teuthology.misc.health.smithi164.stdout:{"epoch":19,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:39.531869+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 msgr2=0x7f6a10074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 0x7f6a10074570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f70 tx=0x7f6a24009040 comp rx=0 tx=0).stop 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 msgr2=0x7f6a3415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00e970 tx=0x7f6a2c00ee30 comp rx=0 tx=0).stop 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 shutdown_connections 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6a10072060 0x7f6a10074570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.877 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a341527f0 0x7f6a3415b070 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.878 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a340c1b70 0x7f6a3414c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.878 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 --2- 172.21.15.164:0/4180933066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a34074db0 0x7f6a340c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:40.878 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 >> 172.21.15.164:0/4180933066 conn(0x7f6a34070e40 msgr2=0x7f6a3415c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:40.878 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 shutdown_connections 2024-08-31T12:13:40.878 INFO:teuthology.misc.health.smithi164.stderr:2024-08-31T12:13:40.873+0000 7f6a3ba00640 1 -- 172.21.15.164:0/4180933066 wait complete. 2024-08-31T12:13:40.895 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-31T12:13:40.895 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-31T12:13:40.896 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-31T12:13:40.896 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-31T12:13:40.899 INFO:tasks.ceph.mds.a:Started 2024-08-31T12:13:40.899 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-31T12:13:40.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-31T12:13:40.902 INFO:tasks.ceph.mds.c:Started 2024-08-31T12:13:40.902 INFO:tasks.ceph.mds.e:Restarting daemon 2024-08-31T12:13:40.902 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-08-31T12:13:40.905 INFO:tasks.ceph.mds.e:Started 2024-08-31T12:13:40.905 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-31T12:13:40.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-31T12:13:40.909 INFO:tasks.ceph.mds.b:Started 2024-08-31T12:13:40.910 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-31T12:13:40.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-31T12:13:40.912 INFO:tasks.ceph.mds.d:Started 2024-08-31T12:13:40.912 INFO:tasks.ceph.mds.f:Restarting daemon 2024-08-31T12:13:40.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-08-31T12:13:40.915 INFO:tasks.ceph.mds.f:Started 2024-08-31T12:13:40.915 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-31T12:13:40.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:13:41.010 INFO:tasks.ceph.mds.e.smithi164.stdout:starting mds.e at 2024-08-31T12:13:41.018 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2024-08-31T12:13:41.019 INFO:tasks.ceph.mds.f.smithi184.stdout:starting mds.f at 2024-08-31T12:13:41.019 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2024-08-31T12:13:41.024 INFO:tasks.ceph.mds.a.smithi164.stdout:starting mds.a at 2024-08-31T12:13:41.026 INFO:tasks.ceph.mds.c.smithi164.stdout:starting mds.c at 2024-08-31T12:13:41.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 -- 172.21.15.164:0/2614413472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 msgr2=0x7fcb180c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 --2- 172.21.15.164:0/2614413472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb180c6a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb18072d90 tx=0x7fcb1001f580 comp rx=0 tx=0).stop 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 -- 172.21.15.164:0/2614413472 shutdown_connections 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 --2- 172.21.15.164:0/2614413472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb180c6a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 --2- 172.21.15.164:0/2614413472 >> v2:172.21.15.184:3300/0 conn(0x7fcb18074ed0 0x7fcb180c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 -- 172.21.15.164:0/2614413472 >> 172.21.15.164:0/2614413472 conn(0x7fcb180cca80 msgr2=0x7fcb180cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 -- 172.21.15.164:0/2614413472 shutdown_connections 2024-08-31T12:13:41.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.081+0000 7fcb17200640 1 -- 172.21.15.164:0/2614413472 wait complete. 2024-08-31T12:13:41.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 Processor -- start 2024-08-31T12:13:41.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- start start 2024-08-31T12:13:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb1814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 0x7fcb181f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180c4950 con 0x7fcb180c6620 2024-08-31T12:13:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18074bb0 con 0x7fcb18074ed0 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcb180c4c30 con 0x7fcb18158fd0 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb1814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:35424/0 (socket says 172.21.15.164:35424) 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 -- 172.21.15.164:0/3376613582 learned_addr learned my addr 172.21.15.164:0/3376613582 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:41.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb16800640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 0x7fcb181f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:41.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 -- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 msgr2=0x7fcb181f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:41.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 0x7fcb181f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 -- 172.21.15.164:0/3376613582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 msgr2=0x7fcb1814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:41.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb1814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 -- 172.21.15.164:0/3376613582 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb180c3130 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb16800640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 0x7fcb181f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb0fe00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb1814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb15e00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800e970 tx=0x7fcb0800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800cd80 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1814c850 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb08004020 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08004470 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.085+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb18152230 con 0x7fcb18074ed0 2024-08-31T12:13:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb181583d0 con 0x7fcb18074ed0 2024-08-31T12:13:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 4) ==== 95888+0+0 (secure 0 0 0) 0x7fcb08005030 con 0x7fcb18074ed0 2024-08-31T12:13:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb0e000640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 0x7fcaf4074570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fcb08092ff0 con 0x7fcb18074ed0 2024-08-31T12:13:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb0fe00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 0x7fcaf4074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.089+0000 7fcb0fe00640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 0x7fcaf4074570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb181567d0 tx=0x7fcb00009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:41.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.101+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcb0805ed10 con 0x7fcb18074ed0 2024-08-31T12:13:41.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.301+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb180c6120 con 0x7fcb18074ed0 2024-08-31T12:13:41.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.301+0000 7fcb0e000640 1 -- 172.21.15.164:0/3376613582 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fcb080671c0 con 0x7fcb18074ed0 2024-08-31T12:13:41.304 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":2,"btime":"2024-08-31T12:13:41:026423+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T12:13:41.305 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 2 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 msgr2=0x7fcaf4074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 0x7fcaf4074570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb181567d0 tx=0x7fcb00009040 comp rx=0 tx=0).stop 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 msgr2=0x7fcb18156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800e970 tx=0x7fcb0800ee30 comp rx=0 tx=0).stop 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 shutdown_connections 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcaf4072060 0x7fcaf4074570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb18158fd0 0x7fcb181f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb180c6620 0x7fcb1814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 --2- 172.21.15.164:0/3376613582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb18074ed0 0x7fcb18156d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:41.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 >> 172.21.15.164:0/3376613582 conn(0x7fcb180cca80 msgr2=0x7fcb18154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:41.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 shutdown_connections 2024-08-31T12:13:41.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:41.305+0000 7fcb17200640 1 -- 172.21.15.164:0/3376613582 wait complete. 2024-08-31T12:13:43.328 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:13:43.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- 172.21.15.164:0/3159164409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c15bc70 msgr2=0x7fed7c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 --2- 172.21.15.164:0/3159164409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c15bc70 0x7fed7c152a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0c9020 tx=0x7fed6c01f0d0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- 172.21.15.164:0/3159164409 shutdown_connections 2024-08-31T12:13:43.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 --2- 172.21.15.164:0/3159164409 >> v2:172.21.15.184:3300/0 conn(0x7fed7c0c1f40 0x7fed7c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 --2- 172.21.15.164:0/3159164409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c15bc70 0x7fed7c152a10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- 172.21.15.164:0/3159164409 >> 172.21.15.164:0/3159164409 conn(0x7fed7c0ccf20 msgr2=0x7fed7c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:43.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- 172.21.15.164:0/3159164409 shutdown_connections 2024-08-31T12:13:43.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- 172.21.15.164:0/3159164409 wait complete. 2024-08-31T12:13:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 Processor -- start 2024-08-31T12:13:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.493+0000 7fed80e00640 1 -- start start 2024-08-31T12:13:43.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c0c1f40 0x7fed7c1e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed7c15bc70 0x7fed7c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c074fb0 con 0x7fed7c0c7920 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c074e30 con 0x7fed7c15bc70 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c0c7d30 con 0x7fed7c0c1f40 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37192/0 (socket says 172.21.15.164:37192) 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 -- 172.21.15.164:0/1231524981 learned_addr learned my addr 172.21.15.164:0/1231524981 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed79e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c0c1f40 0x7fed7c1e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed7a800640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed7c15bc70 0x7fed7c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 -- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c0c1f40 msgr2=0x7fed7c1e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c0c1f40 0x7fed7c1e6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 -- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed7c15bc70 msgr2=0x7fed7c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed7c15bc70 0x7fed7c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 -- 172.21.15.164:0/1231524981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c1e6b40 con 0x7fed7c0c7920 2024-08-31T12:13:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed71400640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed6400e6f0 tx=0x7fed6400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64004220 con 0x7fed7c0c7920 2024-08-31T12:13:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed640043e0 con 0x7fed7c0c7920 2024-08-31T12:13:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c0cbe60 con 0x7fed7c0c7920 2024-08-31T12:13:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6400cb10 con 0x7fed7c0c7920 2024-08-31T12:13:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c0cc970 con 0x7fed7c0c7920 2024-08-31T12:13:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.497+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c0c9330 con 0x7fed7c0c7920 2024-08-31T12:13:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.501+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fed6400ccb0 con 0x7fed7c0c7920 2024-08-31T12:13:43.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.501+0000 7fed72a00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 0x7fed58074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.501+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fed64093000 con 0x7fed7c0c7920 2024-08-31T12:13:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.501+0000 7fed79e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 0x7fed58074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.501+0000 7fed79e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 0x7fed58074600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0b2000 tx=0x7fed6c01d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:43.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.505+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fed6405e5c0 con 0x7fed7c0c7920 2024-08-31T12:13:43.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.705+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed7c06a5f0 con 0x7fed7c0c7920 2024-08-31T12:13:43.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.705+0000 7fed72a00640 1 -- 172.21.15.164:0/1231524981 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5572 (secure 0 0 0) 0x7fed64062d80 con 0x7fed7c0c7920 2024-08-31T12:13:43.710 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:43.710 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":3,"btime":"2024-08-31T12:13:42:027954+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4393,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T12:13:43.710 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 3 2024-08-31T12:13:43.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 msgr2=0x7fed58074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 0x7fed58074600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0b2000 tx=0x7fed6c01d910 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 msgr2=0x7fed7c0738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed6400e6f0 tx=0x7fed6400ebb0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 shutdown_connections 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fed580720f0 0x7fed58074600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed7c15bc70 0x7fed7c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed7c0c7920 0x7fed7c0738a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 --2- 172.21.15.164:0/1231524981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed7c0c1f40 0x7fed7c1e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 >> 172.21.15.164:0/1231524981 conn(0x7fed7c0ccf20 msgr2=0x7fed7c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 shutdown_connections 2024-08-31T12:13:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.709+0000 7fed80e00640 1 -- 172.21.15.164:0/1231524981 wait complete. 2024-08-31T12:13:43.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-31T12:13:43.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- 172.21.15.164:0/1639570788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d00c3030 msgr2=0x7ff2d00c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/1639570788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d00c3030 0x7ff2d00c3840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009900 tx=0x7ff2c001f0d0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- 172.21.15.164:0/1639570788 shutdown_connections 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/1639570788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d0158e60 0x7ff2d00c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/1639570788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d00c3030 0x7ff2d00c3840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- 172.21.15.164:0/1639570788 >> 172.21.15.164:0/1639570788 conn(0x7ff2d00721e0 msgr2=0x7ff2d00725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- 172.21.15.164:0/1639570788 shutdown_connections 2024-08-31T12:13:43.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- 172.21.15.164:0/1639570788 wait complete. 2024-08-31T12:13:43.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 Processor -- start 2024-08-31T12:13:43.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.881+0000 7ff2d5e00640 1 -- start start 2024-08-31T12:13:43.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2d00c3030 0x7ff2d01f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 0x7ff2d0154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d00cb300 con 0x7ff2d0158e60 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d00cb020 con 0x7ff2d00c3030 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d00c50e0 con 0x7ff2d00c8a10 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37202/0 (socket says 172.21.15.164:37202) 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 -- 172.21.15.164:0/36708815 learned_addr learned my addr 172.21.15.164:0/36708815 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cea00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2d00c3030 0x7ff2d01f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2c6000640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 0x7ff2d0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 -- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 msgr2=0x7ff2d0154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 0x7ff2d0154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 -- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2d00c3030 msgr2=0x7ff2d01f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2d00c3030 0x7ff2d01f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 -- 172.21.15.164:0/36708815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d014c160 con 0x7ff2d0158e60 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2c6000640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 0x7ff2d0154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2cf400640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800eab0 tx=0x7ff2c8009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800ce40 con 0x7ff2d0158e60 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2c8004c20 con 0x7ff2d0158e60 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8005020 con 0x7ff2d0158e60 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d014c400 con 0x7ff2d0158e60 2024-08-31T12:13:43.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d014c840 con 0x7ff2d0158e60 2024-08-31T12:13:43.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.885+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d01f2090 con 0x7ff2d0158e60 2024-08-31T12:13:43.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.889+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff2c80051e0 con 0x7ff2d0158e60 2024-08-31T12:13:43.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.889+0000 7ff2c7e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 0x7ff2ac074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:43.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.889+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff2c8093550 con 0x7ff2d0158e60 2024-08-31T12:13:43.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.889+0000 7ff2cea00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 0x7ff2ac074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:43.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.889+0000 7ff2cea00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 0x7ff2ac074620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00b2000 tx=0x7ff2c001d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:43.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:43.893+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff2c805f1d0 con 0x7ff2d0158e60 2024-08-31T12:13:44.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.061+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff2d0152b20 con 0x7ff2d0158e60 2024-08-31T12:13:44.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.061+0000 7ff2c7e00640 1 -- 172.21.15.164:0/36708815 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7ff2c805ead0 con 0x7ff2d0158e60 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout:[ 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout: "poolnum": 1, 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout: "poolname": ".mgr" 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-08-31T12:13:44.065 INFO:teuthology.orchestra.run.smithi164.stdout:] 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 msgr2=0x7ff2ac074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 0x7ff2ac074620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00b2000 tx=0x7ff2c001d910 comp rx=0 tx=0).stop 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 msgr2=0x7ff2d014cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800eab0 tx=0x7ff2c8009f70 comp rx=0 tx=0).stop 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 shutdown_connections 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac072110 0x7ff2ac074620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2d0158e60 0x7ff2d014cf40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2d00c8a10 0x7ff2d0154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 --2- 172.21.15.164:0/36708815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2d00c3030 0x7ff2d01f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 >> 172.21.15.164:0/36708815 conn(0x7ff2d00721e0 msgr2=0x7ff2d0157680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:44.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 shutdown_connections 2024-08-31T12:13:44.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.065+0000 7ff2d5e00640 1 -- 172.21.15.164:0/36708815 wait complete. 2024-08-31T12:13:44.086 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T12:13:44.087 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T12:13:44.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- 172.21.15.164:0/4025519306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3aa8003fe0 msgr2=0x7f3aa8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/4025519306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3aa8003fe0 0x7f3aa8004810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c310 tx=0x7f3ab001f6e0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac3400640 1 -- 172.21.15.164:0/4025519306 reap_dead start 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- 172.21.15.164:0/4025519306 shutdown_connections 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- 172.21.15.164:0/4025519306 >> 172.21.15.164:0/4025519306 conn(0x7f3ac40ccf20 msgr2=0x7f3ac40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- 172.21.15.164:0/4025519306 shutdown_connections 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- 172.21.15.164:0/4025519306 wait complete. 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 Processor -- start 2024-08-31T12:13:44.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.245+0000 7f3ac9e00640 1 -- start start 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa8003fe0 0x7f3ac41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40cc410 0x7f3ac4146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4074a80 con 0x7f3ac41e5120 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4074900 con 0x7f3aa8003fe0 2024-08-31T12:13:44.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac40c9680 con 0x7f3ac40cc410 2024-08-31T12:13:44.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa8003fe0 0x7f3ac41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37206/0 (socket says 172.21.15.164:37206) 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 -- 172.21.15.164:0/408097637 learned_addr learned my addr 172.21.15.164:0/408097637 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac2000640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40cc410 0x7f3ac4146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 -- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40cc410 msgr2=0x7f3ac4146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40cc410 0x7f3ac4146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 -- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa8003fe0 msgr2=0x7f3ac41478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa8003fe0 0x7f3ac41478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 -- 172.21.15.164:0/408097637 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40caea0 con 0x7f3ac41e5120 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac3400640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4072e50 tx=0x7f3abc011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc003980 con 0x7f3ac41e5120 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3abc003b20 con 0x7f3ac41e5120 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc004030 con 0x7f3ac41e5120 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac41e5a70 con 0x7f3ac41e5120 2024-08-31T12:13:44.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac40cb140 con 0x7f3ac41e5120 2024-08-31T12:13:44.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac41595a0 con 0x7f3ac41e5120 2024-08-31T12:13:44.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.249+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3abc0041d0 con 0x7f3ac41e5120 2024-08-31T12:13:44.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.253+0000 7f3abb400640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 0x7f3aa40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.253+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3abc093550 con 0x7f3ac41e5120 2024-08-31T12:13:44.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.253+0000 7f3ac2a00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 0x7f3aa40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.253+0000 7f3ac2a00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 0x7f3aa40745d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009ce0 tx=0x7f3ab40091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:44.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.257+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3abc021020 con 0x7f3ac41e5120 2024-08-31T12:13:44.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.421+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3ac40cd610 con 0x7f3ac41e5120 2024-08-31T12:13:44.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3abb400640 1 -- 172.21.15.164:0/408097637 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f3abc05f0c0 con 0x7f3ac41e5120 2024-08-31T12:13:44.634 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_metadata' created 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 msgr2=0x7f3aa40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 0x7f3aa40745d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009ce0 tx=0x7f3ab40091e0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 msgr2=0x7f3ac41e5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4072e50 tx=0x7f3abc011ef0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 shutdown_connections 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3aa40720c0 0x7f3aa40745d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ac41e5120 0x7f3ac41e5530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40cc410 0x7f3ac4146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 --2- 172.21.15.164:0/408097637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa8003fe0 0x7f3ac41478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 >> 172.21.15.164:0/408097637 conn(0x7f3ac40ccf20 msgr2=0x7f3ac41585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 shutdown_connections 2024-08-31T12:13:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.633+0000 7f3ac9e00640 1 -- 172.21.15.164:0/408097637 wait complete. 2024-08-31T12:13:44.663 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-31T12:13:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 -- 172.21.15.164:0/2177868189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2d20 msgr2=0x7fdcb00c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 --2- 172.21.15.164:0/2177868189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2d20 0x7fdcb00c1ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009900 tx=0x7fdc9c01c850 comp rx=0 tx=0).stop 2024-08-31T12:13:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 -- 172.21.15.164:0/2177868189 shutdown_connections 2024-08-31T12:13:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 --2- 172.21.15.164:0/2177868189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00c90e0 0x7fdcb00747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 --2- 172.21.15.164:0/2177868189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2d20 0x7fdcb00c1ed0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 -- 172.21.15.164:0/2177868189 >> 172.21.15.164:0/2177868189 conn(0x7fdcb00c99b0 msgr2=0x7fdcb00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:44.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 -- 172.21.15.164:0/2177868189 shutdown_connections 2024-08-31T12:13:44.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.821+0000 7fdcb5600640 1 -- 172.21.15.164:0/2177868189 wait complete. 2024-08-31T12:13:44.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 Processor -- start 2024-08-31T12:13:44.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- start start 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00b2d20 0x7fdcb015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 0x7fdcb014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0165770 con 0x7fdcb00b2860 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb01658f0 con 0x7fdcb00c90e0 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb0165a70 con 0x7fdcb00b2d20 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37218/0 (socket says 172.21.15.164:37218) 2024-08-31T12:13:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 -- 172.21.15.164:0/883847786 learned_addr learned my addr 172.21.15.164:0/883847786 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaf400640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 0x7fdcb014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcae000640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00b2d20 0x7fdcb015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 -- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00b2d20 msgr2=0x7fdcb015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00b2d20 0x7fdcb015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 -- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 msgr2=0x7fdcb014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 0x7fdcb014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 -- 172.21.15.164:0/883847786 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb01f70a0 con 0x7fdcb00b2860 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaf400640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 0x7fdcb014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcaea00640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c3f0 tx=0x7fdca000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0017070 con 0x7fdcb00b2860 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdca00053c0 con 0x7fdcb00b2860 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb014d8b0 con 0x7fdcb00b2860 2024-08-31T12:13:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0003860 con 0x7fdcb00b2860 2024-08-31T12:13:44.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.825+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb014de70 con 0x7fdcb00b2860 2024-08-31T12:13:44.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.829+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb00c1ed0 con 0x7fdcb00b2860 2024-08-31T12:13:44.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.829+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdca001a070 con 0x7fdcb00b2860 2024-08-31T12:13:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.829+0000 7fdca6a00640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 0x7fdc900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.829+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fdca0092160 con 0x7fdcb00b2860 2024-08-31T12:13:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.829+0000 7fdcae000640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 0x7fdc900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:44.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.833+0000 7fdcae000640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 0x7fdc900745d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0af000 tx=0x7fdc9c01b090 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:44.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:44.833+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdca0021020 con 0x7fdcb00b2860 2024-08-31T12:13:45.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.001+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fdcb0151610 con 0x7fdcb00b2860 2024-08-31T12:13:45.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.641+0000 7fdca6a00640 1 -- 172.21.15.164:0/883847786 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7fdca005dc70 con 0x7fdcb00b2860 2024-08-31T12:13:45.645 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data' created 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 msgr2=0x7fdc900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 0x7fdc900745d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0af000 tx=0x7fdc9c01b090 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 msgr2=0x7fdcb01f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c3f0 tx=0x7fdca000c8b0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 shutdown_connections 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdc900720c0 0x7fdc900745d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb00c90e0 0x7fdcb014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb00b2d20 0x7fdcb015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 --2- 172.21.15.164:0/883847786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb00b2860 0x7fdcb01f6b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 >> 172.21.15.164:0/883847786 conn(0x7fdcb00c99b0 msgr2=0x7fdcb0156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 shutdown_connections 2024-08-31T12:13:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.645+0000 7fdcb5600640 1 -- 172.21.15.164:0/883847786 wait complete. 2024-08-31T12:13:45.698 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- 172.21.15.164:0/2063028180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c1581a0 msgr2=0x7fe20c1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 --2- 172.21.15.164:0/2063028180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c1581a0 0x7fe20c1585b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe20c073630 tx=0x7fe1f401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- 172.21.15.164:0/2063028180 shutdown_connections 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 --2- 172.21.15.164:0/2063028180 >> v2:172.21.15.184:3300/0 conn(0x7fe20c0736a0 0x7fe20c073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 --2- 172.21.15.164:0/2063028180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c1581a0 0x7fe20c1585b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 --2- 172.21.15.164:0/2063028180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c151dc0 0x7fe20c0749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- 172.21.15.164:0/2063028180 >> 172.21.15.164:0/2063028180 conn(0x7fe20c0c99b0 msgr2=0x7fe20c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- 172.21.15.164:0/2063028180 shutdown_connections 2024-08-31T12:13:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- 172.21.15.164:0/2063028180 wait complete. 2024-08-31T12:13:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 Processor -- start 2024-08-31T12:13:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.853+0000 7fe211000640 1 -- start start 2024-08-31T12:13:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe20c0736a0 0x7fe20c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 0x7fe20c147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0c2770 con 0x7fe20c151dc0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0c2490 con 0x7fe20c0736a0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c1521d0 con 0x7fe20c1581a0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38732/0 (socket says 172.21.15.164:38732) 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 -- 172.21.15.164:0/2437656714 learned_addr learned my addr 172.21.15.164:0/2437656714 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe209e00640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe20c0736a0 0x7fe20c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe20a800640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 0x7fe20c147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 -- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 msgr2=0x7fe20c147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 0x7fe20c147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 -- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe20c0736a0 msgr2=0x7fe20c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:45.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe20c0736a0 0x7fe20c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 -- 172.21.15.164:0/2437656714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c0c4fb0 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe20a800640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 0x7fe20c147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe201400640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1f401d760 tx=0x7fe1f4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40b5040 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1f4005320 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20c0c5570 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40046d0 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20c0c4230 con 0x7fe20c151dc0 2024-08-31T12:13:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.857+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20c0c79f0 con 0x7fe20c151dc0 2024-08-31T12:13:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.861+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe1f4004890 con 0x7fe20c151dc0 2024-08-31T12:13:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.861+0000 7fe202a00640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 0x7fe1e8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.861+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fe1f4130050 con 0x7fe20c151dc0 2024-08-31T12:13:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.861+0000 7fe209e00640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 0x7fe1e8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:45.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.861+0000 7fe209e00640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 0x7fe1e8074600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00dab0 tx=0x7fe1fc00d490 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:45.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:45.865+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe1f40c1060 con 0x7fe20c151dc0 2024-08-31T12:13:46.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.065+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe20c0b2820 con 0x7fe20c151dc0 2024-08-31T12:13:46.674 INFO:teuthology.orchestra.run.smithi164.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T12:13:46.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.669+0000 7fe202a00640 1 -- 172.21.15.164:0/2437656714 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe1f4018c10 con 0x7fe20c151dc0 2024-08-31T12:13:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 msgr2=0x7fe1e8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 0x7fe1e8074600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00dab0 tx=0x7fe1fc00d490 comp rx=0 tx=0).stop 2024-08-31T12:13:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 msgr2=0x7fe20c147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1f401d760 tx=0x7fe1f4005d80 comp rx=0 tx=0).stop 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 shutdown_connections 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1e80720f0 0x7fe1e8074600 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00dab0 tx=0x7fe1fc00d490 comp rx=0 tx=0).stop 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe20c1581a0 0x7fe20c147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe20c151dc0 0x7fe20c147790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 --2- 172.21.15.164:0/2437656714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe20c0736a0 0x7fe20c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.677+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 >> 172.21.15.164:0/2437656714 conn(0x7fe20c0c99b0 msgr2=0x7fe20c074110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.681+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 shutdown_connections 2024-08-31T12:13:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.681+0000 7fe211000640 1 -- 172.21.15.164:0/2437656714 wait complete. 2024-08-31T12:13:46.711 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-31T12:13:46.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- 172.21.15.164:0/282934207 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd49c003a60 msgr2=0x7fd49c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 --2- 172.21.15.164:0/282934207 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd49c003a60 0x7fd49c003ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009b60 tx=0x7fd4a801d270 comp rx=0 tx=0).stop 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- 172.21.15.164:0/282934207 shutdown_connections 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 --2- 172.21.15.164:0/282934207 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd49c003a60 0x7fd49c003ed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- 172.21.15.164:0/282934207 >> 172.21.15.164:0/282934207 conn(0x7fd4b80ccf20 msgr2=0x7fd4b80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- 172.21.15.164:0/282934207 shutdown_connections 2024-08-31T12:13:46.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- 172.21.15.164:0/282934207 wait complete. 2024-08-31T12:13:46.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 Processor -- start 2024-08-31T12:13:46.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.869+0000 7fd4bce00640 1 -- start start 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49c003a60 0x7fd4b80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b81ea7b0 0x7fd4b8147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b81527d0 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8152950 con 0x7fd4b81ea7b0 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b8152ad0 con 0x7fd49c003a60 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38772/0 (socket says 172.21.15.164:38772) 2024-08-31T12:13:46.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 -- 172.21.15.164:0/2376403899 learned_addr learned my addr 172.21.15.164:0/2376403899 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4b6800640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b81ea7b0 0x7fd4b8147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4b5e00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49c003a60 0x7fd4b80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 -- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49c003a60 msgr2=0x7fd4b80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49c003a60 0x7fd4b80c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 -- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b81ea7b0 msgr2=0x7fd4b8147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b81ea7b0 0x7fd4b8147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 -- 172.21.15.164:0/2376403899 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b80c4c40 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4ad400640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0004da0 tx=0x7fd4a0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0001d50 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4a0016070 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0010b40 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b81f9510 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b81e8730 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8073680 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.873+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd4a0010ce0 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.877+0000 7fd4aea00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 0x7fd4940745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:46.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.877+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd4a0093340 con 0x7fd4b81ea3a0 2024-08-31T12:13:46.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.877+0000 7fd4b5e00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 0x7fd4940745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:46.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.877+0000 7fd4b5e00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 0x7fd4940745d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ae000 tx=0x7fd4a801a010 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:46.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:46.881+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd4a005e630 con 0x7fd4b81ea3a0 2024-08-31T12:13:47.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.053+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd4b8151d40 con 0x7fd4b81ea3a0 2024-08-31T12:13:47.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.645+0000 7fd4aea00640 1 -- 172.21.15.164:0/2376403899 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7fd4a0067130 con 0x7fd4b81ea3a0 2024-08-31T12:13:47.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 msgr2=0x7fd4940745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 0x7fd4940745d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ae000 tx=0x7fd4a801a010 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 msgr2=0x7fd4b814dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0004da0 tx=0x7fd4a0001640 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 shutdown_connections 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd4940720c0 0x7fd4940745d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b81ea7b0 0x7fd4b8147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b81ea3a0 0x7fd4b814dc30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 --2- 172.21.15.164:0/2376403899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49c003a60 0x7fd4b80c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 >> 172.21.15.164:0/2376403899 conn(0x7fd4b80ccf20 msgr2=0x7fd4b806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 shutdown_connections 2024-08-31T12:13:47.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.649+0000 7fd4bce00640 1 -- 172.21.15.164:0/2376403899 wait complete. 2024-08-31T12:13:47.674 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T12:13:47.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- 172.21.15.164:0/3018688278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 msgr2=0x7fc6700747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:47.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 --2- 172.21.15.164:0/3018688278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700747b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6700cdf70 tx=0x7fc66801ccc0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- 172.21.15.164:0/3018688278 shutdown_connections 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 --2- 172.21.15.164:0/3018688278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700747b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 --2- 172.21.15.164:0/3018688278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 0x7fc670152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 --2- 172.21.15.164:0/3018688278 >> v2:172.21.15.184:3300/0 conn(0x7fc6700b2860 0x7fc6700b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- 172.21.15.164:0/3018688278 >> 172.21.15.164:0/3018688278 conn(0x7fc6700c99b0 msgr2=0x7fc6700c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- 172.21.15.164:0/3018688278 shutdown_connections 2024-08-31T12:13:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- 172.21.15.164:0/3018688278 wait complete. 2024-08-31T12:13:47.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 Processor -- start 2024-08-31T12:13:47.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.837+0000 7fc677a00640 1 -- start start 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6700b2860 0x7fc6701536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 0x7fc670161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700c32e0 con 0x7fc6700c90e0 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700c3160 con 0x7fc6700b2860 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc6701585d0 con 0x7fc6700c1ed0 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38780/0 (socket says 172.21.15.164:38780) 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 -- 172.21.15.164:0/1608868170 learned_addr learned my addr 172.21.15.164:0/1608868170 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675000640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6700b2860 0x7fc6701536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc66fe00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 0x7fc670161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 -- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 msgr2=0x7fc670161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:47.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 0x7fc670161470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 -- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6700b2860 msgr2=0x7fc6701536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:47.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6700b2860 0x7fc6701536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:47.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 -- 172.21.15.164:0/1608868170 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6701619b0 con 0x7fc6700c90e0 2024-08-31T12:13:47.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc675a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc66801b370 tx=0x7fc668005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:47.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680bb070 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc668004d40 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680b2040 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6700b2e80 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701f6030 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.841+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc670152780 con 0x7fc6700c90e0 2024-08-31T12:13:47.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.845+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc6680be070 con 0x7fc6700c90e0 2024-08-31T12:13:47.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.845+0000 7fc66cc00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 0x7fc6500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:47.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.845+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fc66812cb20 con 0x7fc6700c90e0 2024-08-31T12:13:47.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.845+0000 7fc675000640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 0x7fc6500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:47.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.845+0000 7fc675000640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 0x7fc6500745d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66000bb50 tx=0x7fc66000b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:47.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:47.849+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc668016970 con 0x7fc6700c90e0 2024-08-31T12:13:48.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:48.017+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc670157e10 con 0x7fc6700c90e0 2024-08-31T12:13:49.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.681+0000 7fc66cc00640 1 -- 172.21.15.164:0/1608868170 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fc6680f7ce0 con 0x7fc6700c90e0 2024-08-31T12:13:49.685 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data_ec' created 2024-08-31T12:13:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 msgr2=0x7fc6500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 0x7fc6500745d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66000bb50 tx=0x7fc66000b2e0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 msgr2=0x7fc6700c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc66801b370 tx=0x7fc668005b00 comp rx=0 tx=0).stop 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 shutdown_connections 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc6500720c0 0x7fc6500745d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6700c90e0 0x7fc6700c65b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6700c1ed0 0x7fc670161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 --2- 172.21.15.164:0/1608868170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6700b2860 0x7fc6701536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 >> 172.21.15.164:0/1608868170 conn(0x7fc6700c99b0 msgr2=0x7fc6701517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 shutdown_connections 2024-08-31T12:13:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.685+0000 7fc677a00640 1 -- 172.21.15.164:0/1608868170 wait complete. 2024-08-31T12:13:49.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-31T12:13:49.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- 172.21.15.164:0/784060871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c94a0 msgr2=0x7f8ddc1527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- 172.21.15.164:0/784060871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c94a0 0x7f8ddc1527d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009900 tx=0x7f8dc401c8e0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- 172.21.15.164:0/784060871 shutdown_connections 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- 172.21.15.164:0/784060871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c94a0 0x7f8ddc1527d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- 172.21.15.164:0/784060871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc074fb0 0x7f8ddc0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- 172.21.15.164:0/784060871 >> 172.21.15.164:0/784060871 conn(0x7f8ddc0ccf20 msgr2=0x7f8ddc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- 172.21.15.164:0/784060871 shutdown_connections 2024-08-31T12:13:49.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- 172.21.15.164:0/784060871 wait complete. 2024-08-31T12:13:49.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 Processor -- start 2024-08-31T12:13:49.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- start start 2024-08-31T12:13:49.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ddc074fb0 0x7f8ddc142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:49.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:49.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc0c94a0 0x7f8ddc1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:49.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0c81b0 con 0x7f8ddc0c8560 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0c8030 con 0x7f8ddc074fb0 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.881+0000 7f8de3c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc1657a0 con 0x7f8ddc0c94a0 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38800/0 (socket says 172.21.15.164:38800) 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 -- 172.21.15.164:0/1162352896 learned_addr learned my addr 172.21.15.164:0/1162352896 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:49.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8de1200640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ddc074fb0 0x7f8ddc142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8de1c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc0c94a0 0x7f8ddc1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 -- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc0c94a0 msgr2=0x7f8ddc1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc0c94a0 0x7f8ddc1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 -- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ddc074fb0 msgr2=0x7f8ddc142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ddc074fb0 0x7f8ddc142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 -- 172.21.15.164:0/1162352896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc14d7b0 con 0x7f8ddc0c8560 2024-08-31T12:13:49.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd3e00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009850 tx=0x7f8dc40a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:49.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40b2040 con 0x7f8ddc0c8560 2024-08-31T12:13:49.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc40044b0 con 0x7f8ddc0c8560 2024-08-31T12:13:49.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4005270 con 0x7f8ddc0c8560 2024-08-31T12:13:49.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc143060 con 0x7f8ddc0c8560 2024-08-31T12:13:49.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc14d290 con 0x7f8ddc0c8560 2024-08-31T12:13:49.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc0c3d80 con 0x7f8ddc0c8560 2024-08-31T12:13:49.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.885+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8dc40bd060 con 0x7f8ddc0c8560 2024-08-31T12:13:49.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.889+0000 7f8dd9600640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 0x7f8db8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:49.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.889+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f8dc412cc50 con 0x7f8ddc0c8560 2024-08-31T12:13:49.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.889+0000 7f8de1200640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 0x7f8db8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:49.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.889+0000 7f8de1200640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 0x7f8db8074600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0058d0 tx=0x7f8dcc005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:49.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:49.893+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8dc40164d0 con 0x7f8ddc0c8560 2024-08-31T12:13:50.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.057+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8ddc150e60 con 0x7f8ddc0c8560 2024-08-31T12:13:50.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.689+0000 7f8dd9600640 1 -- 172.21.15.164:0/1162352896 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f8dc40f82f0 con 0x7f8ddc0c8560 2024-08-31T12:13:50.693 INFO:teuthology.orchestra.run.smithi164.stderr:set pool 4 allow_ec_overwrites to true 2024-08-31T12:13:50.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 msgr2=0x7f8db8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:50.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 0x7f8db8074600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0058d0 tx=0x7f8dcc005860 comp rx=0 tx=0).stop 2024-08-31T12:13:50.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 msgr2=0x7f8ddc148290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:50.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009850 tx=0x7f8dc40a5810 comp rx=0 tx=0).stop 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 shutdown_connections 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8db80720f0 0x7f8db8074600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ddc0c94a0 0x7f8ddc1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ddc0c8560 0x7f8ddc148290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 --2- 172.21.15.164:0/1162352896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ddc074fb0 0x7f8ddc142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.693+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 >> 172.21.15.164:0/1162352896 conn(0x7f8ddc0ccf20 msgr2=0x7f8ddc0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:50.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.697+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 shutdown_connections 2024-08-31T12:13:50.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.697+0000 7f8de3c00640 1 -- 172.21.15.164:0/1162352896 wait complete. 2024-08-31T12:13:50.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-31T12:13:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- 172.21.15.164:0/466252353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07d80041d0 msgr2=0x7f07d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:50.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 --2- 172.21.15.164:0/466252353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07d80041d0 0x7f07d8004810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f07dc006f90 tx=0x7f07dc01cec0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07f3e00640 1 -- 172.21.15.164:0/466252353 reap_dead start 2024-08-31T12:13:50.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- 172.21.15.164:0/466252353 shutdown_connections 2024-08-31T12:13:50.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- 172.21.15.164:0/466252353 >> 172.21.15.164:0/466252353 conn(0x7f07f40c99b0 msgr2=0x7f07f40c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:50.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- 172.21.15.164:0/466252353 shutdown_connections 2024-08-31T12:13:50.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- 172.21.15.164:0/466252353 wait complete. 2024-08-31T12:13:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 Processor -- start 2024-08-31T12:13:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.905+0000 7f07fa800640 1 -- start start 2024-08-31T12:13:50.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07d80041d0 0x7f07f41f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:50.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40c66e0 0x7f07f414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:50.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:50.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40c97f0 con 0x7f07f4146820 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4163f60 con 0x7f07d80041d0 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f07f41640e0 con 0x7f07f40c66e0 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38814/0 (socket says 172.21.15.164:38814) 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 -- 172.21.15.164:0/2683986043 learned_addr learned my addr 172.21.15.164:0/2683986043 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3400640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07d80041d0 0x7f07f41f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07ebe00640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40c66e0 0x7f07f414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 -- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40c66e0 msgr2=0x7f07f414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40c66e0 0x7f07f414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 -- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07d80041d0 msgr2=0x7f07f41f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07d80041d0 0x7f07f41f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 -- 172.21.15.164:0/2683986043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f4147170 con 0x7f07f4146820 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07f3e00640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07f40c3c70 tx=0x7f07ec010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:50.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec017070 con 0x7f07f4146820 2024-08-31T12:13:50.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07ec015070 con 0x7f07f4146820 2024-08-31T12:13:50.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f40c71b0 con 0x7f07f4146820 2024-08-31T12:13:50.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004d90 con 0x7f07f4146820 2024-08-31T12:13:50.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f414e030 con 0x7f07f4146820 2024-08-31T12:13:50.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f4152780 con 0x7f07f4146820 2024-08-31T12:13:50.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.909+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f07ec003980 con 0x7f07f4146820 2024-08-31T12:13:50.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.913+0000 7f07eb400640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 0x7f07d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:50.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.913+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f07ec0931c0 con 0x7f07f4146820 2024-08-31T12:13:50.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.913+0000 7f07f3400640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 0x7f07d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:50.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.913+0000 7f07f3400640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 0x7f07d0074600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c10 tx=0x7f07e4006c00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:50.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:50.917+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f07ec05e190 con 0x7f07f4146820 2024-08-31T12:13:51.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.117+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f07f41504f0 con 0x7f07f4146820 2024-08-31T12:13:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.717+0000 7f07eb400640 1 -- 172.21.15.164:0/2683986043 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f07ec062950 con 0x7f07f4146820 2024-08-31T12:13:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:added data pool 4 to fsmap 2024-08-31T12:13:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 msgr2=0x7f07d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 0x7f07d0074600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c10 tx=0x7f07e4006c00 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 msgr2=0x7f07f4146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07f40c3c70 tx=0x7f07ec010e20 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 shutdown_connections 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f07d00720f0 0x7f07d0074600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07f4146820 0x7f07f4146c30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40c66e0 0x7f07f414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 --2- 172.21.15.164:0/2683986043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07d80041d0 0x7f07f41f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 >> 172.21.15.164:0/2683986043 conn(0x7f07f40c99b0 msgr2=0x7f07f40cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 shutdown_connections 2024-08-31T12:13:51.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.721+0000 7f07fa800640 1 -- 172.21.15.164:0/2683986043 wait complete. 2024-08-31T12:13:51.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 -- 172.21.15.164:0/2512557184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4eb4003c20 msgr2=0x7f4eb4004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 --2- 172.21.15.164:0/2512557184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4eb4003c20 0x7f4eb4004070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009b40 tx=0x7f4ec001d270 comp rx=0 tx=0).stop 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ece800640 1 -- 172.21.15.164:0/2512557184 reap_dead start 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 -- 172.21.15.164:0/2512557184 shutdown_connections 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 -- 172.21.15.164:0/2512557184 >> 172.21.15.164:0/2512557184 conn(0x7f4ed00ccf20 msgr2=0x7f4ed00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:51.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 -- 172.21.15.164:0/2512557184 shutdown_connections 2024-08-31T12:13:51.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.897+0000 7f4ed5000640 1 -- 172.21.15.164:0/2512557184 wait complete. 2024-08-31T12:13:51.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 Processor -- start 2024-08-31T12:13:51.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- start start 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4eb4003c20 0x7f4ed015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ed00cb150 0x7f4ed01f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed00c8030 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed00c3150 con 0x7f4ed00cb150 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed0074e30 con 0x7f4eb4003c20 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:51.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38836/0 (socket says 172.21.15.164:38836) 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 -- 172.21.15.164:0/1132462827 learned_addr learned my addr 172.21.15.164:0/1132462827 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ec5400640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ed00cb150 0x7f4ed01f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ecde00640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4eb4003c20 0x7f4ed015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 -- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4eb4003c20 msgr2=0x7f4ed015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4eb4003c20 0x7f4ed015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 -- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ed00cb150 msgr2=0x7f4ed01f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ed00cb150 0x7f4ed01f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 -- 172.21.15.164:0/1132462827 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed015ba70 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ece800640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00cadf0 tx=0x7f4ec800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8015020 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ec800cac0 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed015a600 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8011460 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.901+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed015abc0 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.905+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed0152a10 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.905+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4ec8018020 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.905+0000 7f4ec6a00640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 0x7f4eac0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:51.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.905+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4ec8093450 con 0x7f4ed01e6aa0 2024-08-31T12:13:51.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.905+0000 7f4ecde00640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 0x7f4eac0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:51.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.909+0000 7f4ecde00640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 0x7f4eac0745d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00ad000 tx=0x7f4ec001a010 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:51.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:51.909+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4ec801f020 con 0x7f4ed01e6aa0 2024-08-31T12:13:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ed01f6180 con 0x7f4ed01e6aa0 2024-08-31T12:13:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ec6a00640 1 -- 172.21.15.164:0/1132462827 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6880 (secure 0 0 0) 0x7f4ec805ea50 con 0x7f4ed01e6aa0 2024-08-31T12:13:52.112 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:52.113 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":5,"btime":"2024-08-31T12:13:51:695145+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:13:51.122592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:13:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 5 2024-08-31T12:13:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 msgr2=0x7f4eac0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 0x7f4eac0745d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00ad000 tx=0x7f4ec001a010 comp rx=0 tx=0).stop 2024-08-31T12:13:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 msgr2=0x7f4ed01e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00cadf0 tx=0x7f4ec800eb60 comp rx=0 tx=0).stop 2024-08-31T12:13:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 shutdown_connections 2024-08-31T12:13:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4eac0720c0 0x7f4eac0745d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed01e6aa0 0x7f4ed01e6eb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ed00cb150 0x7f4ed01f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 --2- 172.21.15.164:0/1132462827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4eb4003c20 0x7f4ed015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 >> 172.21.15.164:0/1132462827 conn(0x7f4ed00ccf20 msgr2=0x7f4ed00715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 shutdown_connections 2024-08-31T12:13:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.109+0000 7f4ed5000640 1 -- 172.21.15.164:0/1132462827 wait complete. 2024-08-31T12:13:52.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 -- 172.21.15.164:0/1371855523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c1f40 msgr2=0x7fbf18152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 --2- 172.21.15.164:0/1371855523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c1f40 0x7fbf18152a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009840 tx=0x7fbf0401f010 comp rx=0 tx=0).stop 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 -- 172.21.15.164:0/1371855523 shutdown_connections 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 --2- 172.21.15.164:0/1371855523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c9330 0x7fbf18074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 --2- 172.21.15.164:0/1371855523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c1f40 0x7fbf18152a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 -- 172.21.15.164:0/1371855523 >> 172.21.15.164:0/1371855523 conn(0x7fbf180ccf20 msgr2=0x7fbf180cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 -- 172.21.15.164:0/1371855523 shutdown_connections 2024-08-31T12:13:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.285+0000 7fbf20200640 1 -- 172.21.15.164:0/1371855523 wait complete. 2024-08-31T12:13:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 Processor -- start 2024-08-31T12:13:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- start start 2024-08-31T12:13:52.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c1f40 0x7fbf181f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c9330 0x7fbf181e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbf180c8030 con 0x7fbf1815bc70 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf180c3150 con 0x7fbf180c9330 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbf18074c60 con 0x7fbf180c1f40 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38852/0 (socket says 172.21.15.164:38852) 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 -- 172.21.15.164:0/321676457 learned_addr learned my addr 172.21.15.164:0/321676457 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1ce00640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c9330 0x7fbf181e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1d800640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c1f40 0x7fbf181f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 -- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c1f40 msgr2=0x7fbf181f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c1f40 0x7fbf181f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 -- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c9330 msgr2=0x7fbf181e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c9330 0x7fbf181e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 -- 172.21.15.164:0/321676457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf181f5f50 con 0x7fbf1815bc70 2024-08-31T12:13:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf1e200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000ea80 tx=0x7fbf1000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000cea0 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181e61e0 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf10004b30 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10005020 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.289+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181e67a0 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf18152a10 con 0x7fbf1815bc70 2024-08-31T12:13:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbf100051c0 con 0x7fbf1815bc70 2024-08-31T12:13:52.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf15600640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 0x7fbef80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbf10093b70 con 0x7fbf1815bc70 2024-08-31T12:13:52.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf1d800640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 0x7fbef80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.293+0000 7fbf1d800640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 0x7fbef80745d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0015f0 tx=0x7fbf0c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:52.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.297+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbf1005efd0 con 0x7fbf1815bc70 2024-08-31T12:13:52.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.465+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf1814f760 con 0x7fbf1815bc70 2024-08-31T12:13:52.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.465+0000 7fbf15600640 1 -- 172.21.15.164:0/321676457 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7fbf1005e8d0 con 0x7fbf1815bc70 2024-08-31T12:13:52.469 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:52.470 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:52.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 msgr2=0x7fbef80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 0x7fbef80745d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0015f0 tx=0x7fbf0c009040 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 msgr2=0x7fbf18156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000ea80 tx=0x7fbf1000ef40 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 shutdown_connections 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbef80720c0 0x7fbef80745d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf1815bc70 0x7fbf18156e20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180c9330 0x7fbf181e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 --2- 172.21.15.164:0/321676457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180c1f40 0x7fbf181f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 >> 172.21.15.164:0/321676457 conn(0x7fbf180ccf20 msgr2=0x7fbf180c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 shutdown_connections 2024-08-31T12:13:52.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.469+0000 7fbf20200640 1 -- 172.21.15.164:0/321676457 wait complete. 2024-08-31T12:13:52.492 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 -- 172.21.15.164:0/1574937868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 msgr2=0x7f136815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 --2- 172.21.15.164:0/1574937868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f136815a370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13680746c0 tx=0x7f135401c8c0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 -- 172.21.15.164:0/1574937868 shutdown_connections 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 --2- 172.21.15.164:0/1574937868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 0x7f13680cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 --2- 172.21.15.164:0/1574937868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f136815a370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 --2- 172.21.15.164:0/1574937868 >> v2:172.21.15.184:3300/0 conn(0x7f13680c97e0 0x7f1368156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 -- 172.21.15.164:0/1574937868 >> 172.21.15.164:0/1574937868 conn(0x7f1368071be0 msgr2=0x7f136806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 -- 172.21.15.164:0/1574937868 shutdown_connections 2024-08-31T12:13:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.641+0000 7f136d600640 1 -- 172.21.15.164:0/1574937868 wait complete. 2024-08-31T12:13:52.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 Processor -- start 2024-08-31T12:13:52.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 -- start start 2024-08-31T12:13:52.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13680c97e0 0x7f136814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 0x7f13680c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f13681570b0 con 0x7f1368159f60 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f136808cff0 con 0x7f13680c97e0 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f136d600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f13681596f0 con 0x7f13680cedf0 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f1367400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f1367400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38862/0 (socket says 172.21.15.164:38862) 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f1367400640 1 -- 172.21.15.164:0/1307440020 learned_addr learned my addr 172.21.15.164:0/1307440020 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f1366a00640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13680c97e0 0x7f136814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.645+0000 7f1366000640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 0x7f13680c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 -- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 msgr2=0x7f13680c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 0x7f13680c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 -- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13680c97e0 msgr2=0x7f136814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13680c97e0 0x7f136814f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 -- 172.21.15.164:0/1307440020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136814f560 con 0x7f1368159f60 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f1367400640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f136000e910 tx=0x7f136000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360004d30 con 0x7f1368159f60 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f136000cb20 con 0x7f1368159f60 2024-08-31T12:13:52.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360005020 con 0x7f1368159f60 2024-08-31T12:13:52.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1368076ea0 con 0x7f1368159f60 2024-08-31T12:13:52.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1368158450 con 0x7f1368159f60 2024-08-31T12:13:52.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13680c5d30 con 0x7f1368159f60 2024-08-31T12:13:52.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.649+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f13600051c0 con 0x7f1368159f60 2024-08-31T12:13:52.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.653+0000 7f135ea00640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:52.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.653+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1360093510 con 0x7f1368159f60 2024-08-31T12:13:52.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.653+0000 7f1366a00640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:52.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.653+0000 7f1366a00640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f135800bb50 tx=0x7f135800b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:52.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.657+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1360016030 con 0x7f1368159f60 2024-08-31T12:13:52.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.825+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13680cf390 con 0x7f1368159f60 2024-08-31T12:13:52.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.825+0000 7f135ea00640 1 -- 172.21.15.164:0/1307440020 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f1360067060 con 0x7f1368159f60 2024-08-31T12:13:52.830 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:52.830 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 msgr2=0x7f13480745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f135800bb50 tx=0x7f135800b2e0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 msgr2=0x7f13680ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f136000e910 tx=0x7f136000edd0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 shutdown_connections 2024-08-31T12:13:52.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1368159f60 0x7f13680ce090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13680cedf0 0x7f13680c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 --2- 172.21.15.164:0/1307440020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13680c97e0 0x7f136814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 >> 172.21.15.164:0/1307440020 conn(0x7f1368071be0 msgr2=0x7f1368147ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 shutdown_connections 2024-08-31T12:13:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:52.829+0000 7f136d600640 1 -- 172.21.15.164:0/1307440020 wait complete. 2024-08-31T12:13:52.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:13:53.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 -- 172.21.15.164:0/3235635210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c0c9330 msgr2=0x7f651c074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 --2- 172.21.15.164:0/3235635210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c0c9330 0x7f651c074720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6514009c80 tx=0x7f651401f5a0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 -- 172.21.15.164:0/3235635210 shutdown_connections 2024-08-31T12:13:53.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 --2- 172.21.15.164:0/3235635210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c0c9330 0x7f651c074720 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 --2- 172.21.15.164:0/3235635210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 0x7f651c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 -- 172.21.15.164:0/3235635210 >> 172.21.15.164:0/3235635210 conn(0x7f651c0ccf20 msgr2=0x7f651c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:53.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 -- 172.21.15.164:0/3235635210 shutdown_connections 2024-08-31T12:13:53.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.021+0000 7f6523e00640 1 -- 172.21.15.164:0/3235635210 wait complete. 2024-08-31T12:13:53.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 Processor -- start 2024-08-31T12:13:53.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 -- start start 2024-08-31T12:13:53.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 0x7f651c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f651c0c9330 0x7f651c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f651c0c8030 con 0x7f651c15bc70 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f651c0c3150 con 0x7f651c0c9330 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6523e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f651c074c60 con 0x7f651c0c1f40 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38894/0 (socket says 172.21.15.164:38894) 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 -- 172.21.15.164:0/2391728679 learned_addr learned my addr 172.21.15.164:0/2391728679 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6520a00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f651c0c9330 0x7f651c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521400640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 0x7f651c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 -- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 msgr2=0x7f651c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 0x7f651c0b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 -- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f651c0c9330 msgr2=0x7f651c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f651c0c9330 0x7f651c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 -- 172.21.15.164:0/2391728679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c0cc1a0 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.025+0000 7f6521e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6514009bd0 tx=0x7f65140093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140b6040 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65140b19d0 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651c0ccb90 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140b1e00 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651c15ace0 con 0x7f651c15bc70 2024-08-31T12:13:53.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651c152a10 con 0x7f651c15bc70 2024-08-31T12:13:53.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f65140c1020 con 0x7f651c15bc70 2024-08-31T12:13:53.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 0x7f64fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6514130a60 con 0x7f651c15bc70 2024-08-31T12:13:53.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.029+0000 7f6521400640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 0x7f64fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.033+0000 7f6521400640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 0x7f64fc0745d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f651000b810 tx=0x7f6510008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:53.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.037+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f65140c8020 con 0x7f651c15bc70 2024-08-31T12:13:53.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.237+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f651c1560a0 con 0x7f651c15bc70 2024-08-31T12:13:53.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.237+0000 7f6519600640 1 -- 172.21.15.164:0/2391728679 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6885 (secure 0 0 0) 0x7f65140ab070 con 0x7f651c15bc70 2024-08-31T12:13:53.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:53.241 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"btime":"2024-08-31T12:13:52:732427+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:13:52.722691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:13:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2024-08-31T12:13:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 msgr2=0x7f64fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 0x7f64fc0745d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f651000b810 tx=0x7f6510008040 comp rx=0 tx=0).stop 2024-08-31T12:13:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 msgr2=0x7f651c15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6514009bd0 tx=0x7f65140093d0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 shutdown_connections 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64fc0720c0 0x7f64fc0745d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f651c15bc70 0x7f651c15a7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f651c0c9330 0x7f651c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 --2- 172.21.15.164:0/2391728679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f651c0c1f40 0x7f651c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 >> 172.21.15.164:0/2391728679 conn(0x7f651c0ccf20 msgr2=0x7f651c149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 shutdown_connections 2024-08-31T12:13:53.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.241+0000 7f6523e00640 1 -- 172.21.15.164:0/2391728679 wait complete. 2024-08-31T12:13:53.263 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:13:53.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 -- 172.21.15.164:0/2915164721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 msgr2=0x7f2ef81585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2915164721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef81585e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009900 tx=0x7f2ee801f0d0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 -- 172.21.15.164:0/2915164721 shutdown_connections 2024-08-31T12:13:53.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2915164721 >> v2:172.21.15.184:3300/0 conn(0x7f2ef80ca680 0x7f2ef80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2915164721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef81585e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 -- 172.21.15.164:0/2915164721 >> 172.21.15.164:0/2915164721 conn(0x7f2ef8070da0 msgr2=0x7f2ef80cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:53.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 -- 172.21.15.164:0/2915164721 shutdown_connections 2024-08-31T12:13:53.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.413+0000 7f2efcc00640 1 -- 172.21.15.164:0/2915164721 wait complete. 2024-08-31T12:13:53.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 Processor -- start 2024-08-31T12:13:53.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 -- start start 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ef80ca680 0x7f2ef81503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80cea80 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80ce900 con 0x7f2ef80ca680 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2efcc00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef80c7a00 con 0x7f2ef80c85f0 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38900/0 (socket says 172.21.15.164:38900) 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 -- 172.21.15.164:0/2138857599 learned_addr learned my addr 172.21.15.164:0/2138857599 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7e00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ef80ca680 0x7f2ef81503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef6a00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 -- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 msgr2=0x7f2ef814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 -- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ef80ca680 msgr2=0x7f2ef81503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ef80ca680 0x7f2ef81503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 -- 172.21.15.164:0/2138857599 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef814c930 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.417+0000 7f2ef7400640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80099f0 tx=0x7f2ee80058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b5040 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ee80a8ce0 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef814ced0 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003820 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef80cbe70 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef80caa90 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2ee80c2020 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 0x7f2ed80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:53.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2ee8130760 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.421+0000 7f2ef6a00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 0x7f2ed80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:53.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.425+0000 7f2ef6a00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 0x7f2ed80745d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80c8f90 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:53.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.425+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2ee80c9020 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.593+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ef80c8fc0 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2eef400640 1 -- 172.21.15.164:0/2138857599 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f2ee8018c30 con 0x7f2ef80c3cf0 2024-08-31T12:13:53.599 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:13:53.599 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:13:53.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 msgr2=0x7f2ed80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 0x7f2ed80745d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80c8f90 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 msgr2=0x7f2ef8149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80099f0 tx=0x7f2ee80058c0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 shutdown_connections 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2ed80720c0 0x7f2ed80745d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ef80ca680 0x7f2ef81503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ef80c85f0 0x7f2ef814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 --2- 172.21.15.164:0/2138857599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80c3cf0 0x7f2ef8149f70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 >> 172.21.15.164:0/2138857599 conn(0x7f2ef8070da0 msgr2=0x7f2ef8154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 shutdown_connections 2024-08-31T12:13:53.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:53.597+0000 7f2efcc00640 1 -- 172.21.15.164:0/2138857599 wait complete. 2024-08-31T12:13:54.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T12:13:46.068757+0000', 'modified': '2024-08-31T12:13:52.722691+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4393': {'gid': 4393, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6835/2031819890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 2031819890}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 2031819890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4393, 'qdb_cluster': [4393]} 2024-08-31T12:13:54.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T12:13:54.226 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 -- 172.21.15.164:0/1171418203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c80c9330 msgr2=0x7f46c8074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 --2- 172.21.15.164:0/1171418203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c80c9330 0x7f46c8074720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009bc0 tx=0x7f46c001f3b0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 -- 172.21.15.164:0/1171418203 shutdown_connections 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 --2- 172.21.15.164:0/1171418203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c80c9330 0x7f46c8074720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 --2- 172.21.15.164:0/1171418203 >> v2:172.21.15.184:3300/0 conn(0x7f46c815bc70 0x7f46c8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 -- 172.21.15.164:0/1171418203 >> 172.21.15.164:0/1171418203 conn(0x7f46c80ccf20 msgr2=0x7f46c80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 -- 172.21.15.164:0/1171418203 shutdown_connections 2024-08-31T12:13:54.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.381+0000 7f46cf600640 1 -- 172.21.15.164:0/1171418203 wait complete. 2024-08-31T12:13:54.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 Processor -- start 2024-08-31T12:13:54.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 -- start start 2024-08-31T12:13:54.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c80c1f40 0x7f46c81f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c815bc70 0x7f46c815a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80c8030 con 0x7f46c80c9330 2024-08-31T12:13:54.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80c3150 con 0x7f46c80c1f40 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cf600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f46c8074c60 con 0x7f46c815bc70 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38910/0 (socket says 172.21.15.164:38910) 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 -- 172.21.15.164:0/936573179 learned_addr learned my addr 172.21.15.164:0/936573179 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46ccc00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c80c1f40 0x7f46c81f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46cd600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c815bc70 0x7f46c815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 -- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c815bc70 msgr2=0x7f46c815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c815bc70 0x7f46c815a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 -- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c80c1f40 msgr2=0x7f46c81f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c80c1f40 0x7f46c81f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.385+0000 7f46bfe00640 1 -- 172.21.15.164:0/936573179 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80af4f0 con 0x7f46c80c9330 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46bfe00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c400 tx=0x7f46b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 -- 172.21.15.164:0/936573179 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0011790 con 0x7f46c80c9330 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 -- 172.21.15.164:0/936573179 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b0017070 con 0x7f46c80c9330 2024-08-31T12:13:54.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c81f5a20 con 0x7f46c80c9330 2024-08-31T12:13:54.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 -- 172.21.15.164:0/936573179 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0011cc0 con 0x7f46c80c9330 2024-08-31T12:13:54.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c81f5fe0 con 0x7f46c80c9330 2024-08-31T12:13:54.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 -- 172.21.15.164:0/936573179 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f46b001c460 con 0x7f46c80c9330 2024-08-31T12:13:54.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 0x7f46a4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.389+0000 7f46c5600640 1 -- 172.21.15.164:0/936573179 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f46b0092a70 con 0x7f46c80c9330 2024-08-31T12:13:54.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 Processor -- start 2024-08-31T12:13:54.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 0x7f46a4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- start start 2024-08-31T12:13:54.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 0x7f46a4074600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009600 tx=0x7f46b80091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c593b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c436860 0x564b7c594080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564b7c3af360 con 0x564b7c05d460 2024-08-31T12:13:54.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564b7c39e8f0 con 0x564b7c44cd90 2024-08-31T12:13:54.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x564b7c3a28a0 con 0x564b7c436860 2024-08-31T12:13:54.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38916/0 (socket says 172.21.15.164:38916) 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 -- 172.21.15.164:0/496618512 learned_addr learned my addr 172.21.15.164:0/496618512 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46bfe00640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c593b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46cd600640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c436860 0x564b7c594080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 -- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c436860 msgr2=0x564b7c594080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c436860 0x564b7c594080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 -- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 msgr2=0x564b7c593b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:54.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c593b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 -- 172.21.15.164:0/496618512 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7c33e190 con 0x564b7c05d460 2024-08-31T12:13:54.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46bfe00640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c593b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:54.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46ccc00640 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011e80 tx=0x7f46b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ac91db5c8823c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:54.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46bd200640 1 -- 172.21.15.164:0/496618512 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b800ebf0 con 0x564b7c05d460 2024-08-31T12:13:54.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46bd200640 1 -- 172.21.15.164:0/496618512 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b8004020 con 0x564b7c05d460 2024-08-31T12:13:54.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46bd200640 1 -- 172.21.15.164:0/496618512 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8004430 con 0x564b7c05d460 2024-08-31T12:13:54.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- 172.21.15.164:0/496618512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 msgr2=0x564b7c58feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:54.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011e80 tx=0x7f46b8014000 comp rx=0 tx=0).stop 2024-08-31T12:13:54.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.393+0000 7f46d6c9f000 1 -- 172.21.15.164:0/496618512 shutdown_connections 2024-08-31T12:13:54.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c436860 0x564b7c594080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c593b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/496618512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c58feb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- 172.21.15.164:0/496618512 >> 172.21.15.164:0/496618512 conn(0x564b7c522ae0 msgr2=0x564b7c592910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- 172.21.15.164:0/496618512 shutdown_connections 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- 172.21.15.164:0/496618512 wait complete. 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- start start 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 Processor -- start 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c58ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c58f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564b7c36b500 con 0x564b7c436860 2024-08-31T12:13:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564b7c36c190 con 0x564b7c44cd90 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x564b7c3a1bb0 con 0x564b7c05d460 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 10 client.0 _ll_register_callbacks cb 0x564b7c53f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38930/0 (socket says 172.21.15.164:38930) 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 -- 172.21.15.164:0/3078843318 learned_addr learned my addr 172.21.15.164:0/3078843318 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46cd600640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c58f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46ccc00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c58ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 -- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 msgr2=0x564b7c58ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c58ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 -- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 msgr2=0x564b7c58f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c58f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 -- 172.21.15.164:0/3078843318 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7c339530 con 0x564b7c436860 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46ccc00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c58ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46bfe00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f46b005da40 tx=0x7f46b0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d010c43cb946500 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46b5600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0059620 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f46b005c780 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.397+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b7c338110 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f46b0062270 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 10 client.4428 fetch_fsmap learned FSMap version 7 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x564b7c423ff0 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564b7c338110 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 7) ==== 4720+0+0 (secure 0 0 0) 0x7f46b005c9a0 con 0x564b7c436860 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 10 client.4428 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 20 client.4428 populate_metadata read hostname 'smithi164' 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c0427d0 0x564b7c5a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:54.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 4 client.4428 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:13:54.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 --> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7c3b12b0 con 0x564b7c0427d0 2024-08-31T12:13:54.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46ccc00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c0427d0 0x564b7c5a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:54.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46b5600640 10 client.4428 ms_handle_connect on v2:172.21.15.164:6834/2031819890 2024-08-31T12:13:54.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:54.401+0000 7f46ccc00640 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c0427d0 0x564b7c5a9fe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2e7f3fce8eea23 server_cookie=e4f361d7396f0a21 in_seq=0 out_seq=0 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.729+0000 7f46b5600640 1 -- 172.21.15.164:0/3078843318 <== mds.0 v2:172.21.15.164:6834/2031819890 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b7c3b12b0 con 0x564b7c0427d0 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.729+0000 7f46b5600640 10 client.4428 handle_command_reply: tid=0 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.729+0000 7f46d6c9f000 1 client.4428 shutdown 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 msgr2=0x564b7c58f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f46b005da40 tx=0x7f46b0011f90 comp rx=0 tx=0).stop 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 shutdown_connections 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c0427d0 0x564b7c5a9fe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c58f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c436860 0x564b7c58f1d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/3078843318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c58ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46b5600640 0 client.4428 ms_handle_reset on v2:172.21.15.164:6834/2031819890 2024-08-31T12:13:57.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 >> 172.21.15.164:0/3078843318 conn(0x564b7c522ae0 msgr2=0x564b7c5912c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:57.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 shutdown_connections 2024-08-31T12:13:57.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 1 -- 172.21.15.164:0/3078843318 wait complete. 2024-08-31T12:13:57.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.733+0000 7f46d6c9f000 20 client.4428 trim_cache size 0 max 16384 2024-08-31T12:13:57.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 Processor -- start 2024-08-31T12:13:57.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 -- start start 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c5517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c551d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f46c81ff490 con 0x564b7c522ae0 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46c81fe7f0 con 0x564b7c44cd90 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f46c81fee10 con 0x564b7c05d460 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45062/0 (socket says 172.21.15.164:45062) 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 -- 172.21.15.164:0/2187425091 learned_addr learned my addr 172.21.15.164:0/2187425091 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46cd600640 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c551d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46bfe00640 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c5517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 -- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 msgr2=0x564b7c5517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c5517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 -- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 msgr2=0x564b7c551d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c551d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 -- 172.21.15.164:0/2187425091 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7c3fb4b0 con 0x564b7c522ae0 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.753+0000 7f46ccc00640 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564b7c526a20 tx=0x7f46b80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85072eafa0f9a13a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46b7e00640 1 -- 172.21.15.164:0/2187425091 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b800e9f0 con 0x564b7c522ae0 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46b7e00640 1 -- 172.21.15.164:0/2187425091 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b800ed30 con 0x564b7c522ae0 2024-08-31T12:13:57.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46b7e00640 1 -- 172.21.15.164:0/2187425091 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b80042a0 con 0x564b7c522ae0 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- 172.21.15.164:0/2187425091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 msgr2=0x564b7c552c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564b7c526a20 tx=0x7f46b80046d0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- 172.21.15.164:0/2187425091 shutdown_connections 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c44cd90 0x564b7c551d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c05d460 0x564b7c5517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/2187425091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c522ae0 0x564b7c552c20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- 172.21.15.164:0/2187425091 >> 172.21.15.164:0/2187425091 conn(0x564b7c555f60 msgr2=0x564b7c5a62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:57.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- 172.21.15.164:0/2187425091 shutdown_connections 2024-08-31T12:13:57.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- 172.21.15.164:0/2187425091 wait complete. 2024-08-31T12:13:57.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 -- start start 2024-08-31T12:13:57.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.757+0000 7f46d6c9f000 1 Processor -- start 2024-08-31T12:13:57.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c44cd90 0x564b7c5aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 0x564b7c609ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564b7c356340 con 0x564b7c05d460 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564b7c3a6ed0 con 0x564b7c522ae0 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x564b7c35ede0 con 0x564b7c44cd90 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 10 client.0 _ll_register_callbacks cb 0x7f46b00011b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45076/0 (socket says 172.21.15.164:45076) 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 -- 172.21.15.164:0/180561225 learned_addr learned my addr 172.21.15.164:0/180561225 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46cd600640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 0x564b7c609ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46bfe00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c44cd90 0x564b7c5aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 -- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c44cd90 msgr2=0x564b7c5aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c44cd90 0x564b7c5aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 -- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 msgr2=0x564b7c609ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 0x564b7c609ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 -- 172.21.15.164:0/180561225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7c358f30 con 0x564b7c05d460 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46cd600640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 0x564b7c609ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46ccc00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011810 tx=0x7f46b8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b39bbee4a12ce1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b803d070 con 0x564b7c05d460 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f46b800e9f0 con 0x564b7c05d460 2024-08-31T12:13:57.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b800ed30 con 0x564b7c05d460 2024-08-31T12:13:57.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f46b8048050 con 0x564b7c05d460 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 10 client.4434 fetch_fsmap learned FSMap version 7 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x564b7c344590 con 0x564b7c05d460 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b800ed30 con 0x564b7c05d460 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 7) ==== 4720+0+0 (secure 0 0 0) 0x7f46b804b020 con 0x564b7c05d460 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 10 client.4434 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 20 client.4434 populate_metadata read hostname 'smithi164' 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c030830 0x564b7c60a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 4 client.4434 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 --> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] -- command(tid 0: {"prefix": "status"}) -- 0x564b7c3acd50 con 0x564b7c030830 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46bfe00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c030830 0x564b7c60a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46bfe00640 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c030830 0x564b7c60a000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a208895134e134c server_cookie=a9acac6ae827532a in_seq=0 out_seq=0 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 10 client.4434 ms_handle_connect on v2:172.21.15.164:6834/2031819890 2024-08-31T12:13:57.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 1 -- 172.21.15.164:0/180561225 <== mds.0 v2:172.21.15.164:6834/2031819890 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x564b7c3acd50 con 0x564b7c030830 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46b5600640 10 client.4434 handle_command_reply: tid=0 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.761+0000 7f46d6c9f000 1 client.4434 shutdown 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 msgr2=0x564b7c5ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011810 tx=0x7f46b8011f70 comp rx=0 tx=0).stop 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 shutdown_connections 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x564b7c030830 0x564b7c60a000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b7c522ae0 0x564b7c609ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564b7c44cd90 0x564b7c5aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 --2- 172.21.15.164:0/180561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564b7c05d460 0x564b7c5ae520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46b5600640 0 client.4434 ms_handle_reset on v2:172.21.15.164:6834/2031819890 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 >> 172.21.15.164:0/180561225 conn(0x564b7c555f60 msgr2=0x564b7c5521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 shutdown_connections 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 1 -- 172.21.15.164:0/180561225 wait complete. 2024-08-31T12:13:57.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46d6c9f000 20 client.4434 trim_cache size 0 max 16384 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "0ef23008-1eb0-48b8-823b-3324ee9f8086", 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 0, 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4393, 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 11.081013245999999, 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 6, 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 27, 2024-08-31T12:13:57.770 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 27, 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 16.737737500000001 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 msgr2=0x7f46a4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 0x7f46a4074600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009600 tx=0x7f46b80091e0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 msgr2=0x7f46c814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c400 tx=0x7f46b000c8c0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 shutdown_connections 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f46a40720f0 0x7f46a4074600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46c815bc70 0x7f46c815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c80c9330 0x7f46c814fbf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 --2- 172.21.15.164:0/936573179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c80c1f40 0x7f46c81f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 >> 172.21.15.164:0/936573179 conn(0x7f46c80ccf20 msgr2=0x7f46c80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 shutdown_connections 2024-08-31T12:13:57.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.765+0000 7f46cf600640 1 -- 172.21.15.164:0/936573179 wait complete. 2024-08-31T12:13:57.790 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T12:13:57.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:13:57.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-31T12:13:57.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 -- 172.21.15.164:0/2150235129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 msgr2=0x7f4960074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 --2- 172.21.15.164:0/2150235129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960074720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4958009c80 tx=0x7f495801f5a0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 -- 172.21.15.164:0/2150235129 shutdown_connections 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 --2- 172.21.15.164:0/2150235129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960074720 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 --2- 172.21.15.164:0/2150235129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 0x7f4960152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 -- 172.21.15.164:0/2150235129 >> 172.21.15.164:0/2150235129 conn(0x7f49600ccf20 msgr2=0x7f49600cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 -- 172.21.15.164:0/2150235129 shutdown_connections 2024-08-31T12:13:57.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.945+0000 7f4965400640 1 -- 172.21.15.164:0/2150235129 wait complete. 2024-08-31T12:13:57.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 Processor -- start 2024-08-31T12:13:57.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- start start 2024-08-31T12:13:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 0x7f49600cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 0x7f49601475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f49600c8030 con 0x7f49600c9330 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49600c3150 con 0x7f496015bc70 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4960074c60 con 0x7f49600c1f40 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45102/0 (socket says 172.21.15.164:45102) 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 -- 172.21.15.164:0/1856820292 learned_addr learned my addr 172.21.15.164:0/1856820292 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f495e800640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 0x7f49600cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f495f200640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 0x7f49601475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 -- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 msgr2=0x7f49600cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 0x7f49600cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 -- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 msgr2=0x7f49601475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 0x7f49601475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 -- 172.21.15.164:0/1856820292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496014fd80 con 0x7f49600c9330 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f495f200640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 0x7f49601475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:13:57.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4955e00640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f494800d6b0 tx=0x7f494800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948017070 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4948004310 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948005280 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49601e4740 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.949+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4960144390 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496014fae0 con 0x7f49600c9330 2024-08-31T12:13:57.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4948005420 con 0x7f49600c9330 2024-08-31T12:13:57.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f4957400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 0x7f493c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:13:57.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4948093220 con 0x7f49600c9330 2024-08-31T12:13:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f495e800640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 0x7f493c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:13:57.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.953+0000 7f495e800640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 0x7f493c0745d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4950007fd0 tx=0x7f4950009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:13:57.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:57.957+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f496014fae0 con 0x7f49600c9330 2024-08-31T12:13:58.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.157+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4960152a10 con 0x7f49600c9330 2024-08-31T12:13:58.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.157+0000 7f4957400640 1 -- 172.21.15.164:0/1856820292 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f4948020020 con 0x7f49600c9330 2024-08-31T12:13:58.162 INFO:teuthology.orchestra.run.smithi164.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T12:13:58.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 msgr2=0x7f493c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:58.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 0x7f493c0745d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4950007fd0 tx=0x7f4950009040 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 msgr2=0x7f4960143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f494800d6b0 tx=0x7f494800db70 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 shutdown_connections 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f493c0720c0 0x7f493c0745d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f496015bc70 0x7f49601475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49600c9330 0x7f4960143e50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 --2- 172.21.15.164:0/1856820292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49600c1f40 0x7f49600cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 >> 172.21.15.164:0/1856820292 conn(0x7f49600ccf20 msgr2=0x7f4960149f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 shutdown_connections 2024-08-31T12:13:58.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58.161+0000 7f4965400640 1 -- 172.21.15.164:0/1856820292 wait complete. 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T12:13:58.184 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T12:13:58.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:58.185 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:13:58.194 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42425sec preferred_lft 42425sec 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:1b:65:5d:24 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-31T12:13:58.195 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:13:58.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T12:13:58.196 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:13:58.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:13:58.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:13:58.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:58.354 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T12:13:58.373 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-08-31T12:13:58.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:58.375 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-08-31T12:13:58.647 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-08-31T12:13:58.647 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T12:13:58.647 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-31T12:13:58.647 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:13:58.648 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T12:13:58.648 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:13:58.649 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:13:58.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T12:13:58.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T12:13:58.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T12:13:58.649 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:13:58.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:13:58.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:13:58.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:58.745 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-08-31T12:13:58.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:58.755 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-08-31T12:13:58.806 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:13:58.806 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:13:58.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:13:58.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-31T12:13:58.806 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:13:58.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:13:58.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:13:58.932 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-31T12:13:58.933 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:13:58.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:13:59.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:13:59.100 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:13:59.100 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:13:59.100 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-08-31T12:13:59.100 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T12:13:59.100 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:13:59.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:13:59.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:13:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:13:59.184 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-31T12:13:59.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:13:59.184 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:13:59.193 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T12:13:59.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:13:59.193 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:13:59.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-08-31T12:13:59.306 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-08-31T12:13:59.359 INFO:teuthology.orchestra.run.smithi164.stdout:/run/lock 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/fs/nfsd 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/run/rpc_pipefs 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-08-31T12:13:59.360 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:13:59.361 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:13:59.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:59.362 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-08-31T12:13:59.413 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T12:13:59.414 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-31T12:13:59.460 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-08-31T12:13:59.480 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-08-31T12:13:59.535 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/run/lock 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/fs/nfsd 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:13:59.536 INFO:teuthology.orchestra.run.smithi164.stdout:/run/rpc_pipefs 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:13:59.537 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:13:59.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:13:59.538 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-08-31T12:13:59.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi164.stderr:2024-08-31T12:13:59.565+0000 7f0e0f72f580 -1 init, newargv = 0x55b5b4227160 newargc=15 2024-08-31T12:13:59.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi164.stderr:ceph-fuse[35394]: starting ceph client 2024-08-31T12:13:59.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi164.stderr:ceph-fuse[35394]: starting fuse 2024-08-31T12:14:00.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-08-31T12:14:00.699 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:14:00.751 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-08-31T12:14:00.751 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-08-31T12:14:00.751 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/run/lock 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-08-31T12:14:00.752 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/fs/nfsd 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/run/rpc_pipefs 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-08-31T12:14:00.753 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:14:00.754 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:14:00.754 INFO:teuthology.orchestra.run.smithi164.stdout:/home/ubuntu/cephtest/mnt.admin 2024-08-31T12:14:00.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:00.754 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-08-31T12:14:00.805 INFO:teuthology.orchestra.run.smithi164.stdout:44 2024-08-31T12:14:00.805 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-08-31T12:14:00.806 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.admin")) 2024-08-31T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-08-31T12:14:00.924 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.admin.35394.asok 2024-08-31T12:14:00.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:00.936 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35394.asok 2024-08-31T12:14:00.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:00.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35394.asok status 2024-08-31T12:14:01.114 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:14:01.114 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2024-08-31T12:14:01.114 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T12:14:01.114 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "admin", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "35394", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/" 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4446, 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4446 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-08-31T12:14:01.115 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3742780324 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3742780324 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4446 192.168.0.1:0/3742780324", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "192.168.0.1:0/3742780324", 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 1, 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 6, 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 27, 2024-08-31T12:14:01.116 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2024-08-31T12:14:01.117 INFO:teuthology.orchestra.run.smithi164.stdout: "blocklisted": false, 2024-08-31T12:14:01.117 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2024-08-31T12:14:01.117 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:14:01.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:01.130 DEBUG:teuthology.orchestra.run.smithi164:> stat --file-system '--printf=%T 2024-08-31T12:14:01.130 DEBUG:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:14:01.139 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2024-08-31T12:14:01.139 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:14:01.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:01.140 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:14:01.201 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-31T12:14:01.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T12:14:01.328 INFO:teuthology.orchestra.run.smithi164.stdout:# file: . 2024-08-31T12:14:01.328 INFO:teuthology.orchestra.run.smithi164.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-31T12:14:01.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:01.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:01.335 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:14:01.335 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:14:01.344 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T12:14:01.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 -- 172.21.15.164:0/2603090631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa298004d50 msgr2=0x7fa298005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/2603090631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa298004d50 0x7fa298005160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40735c0 tx=0x7fa2ac01d620 comp rx=0 tx=0).stop 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b3400640 1 -- 172.21.15.164:0/2603090631 reap_dead start 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 -- 172.21.15.164:0/2603090631 shutdown_connections 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 -- 172.21.15.164:0/2603090631 >> 172.21.15.164:0/2603090631 conn(0x7fa2b40ccf20 msgr2=0x7fa2b40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 -- 172.21.15.164:0/2603090631 shutdown_connections 2024-08-31T12:14:01.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.537+0000 7fa2b9c00640 1 -- 172.21.15.164:0/2603090631 wait complete. 2024-08-31T12:14:01.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 Processor -- start 2024-08-31T12:14:01.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- start start 2024-08-31T12:14:01.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298004d50 0x7fa2b415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b41e7720 0x7fa2b414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40c8030 con 0x7fa2b41f5010 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40c3150 con 0x7fa298004d50 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b4074720 con 0x7fa2b41e7720 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298004d50 0x7fa2b415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45120/0 (socket says 172.21.15.164:45120) 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 -- 172.21.15.164:0/871868521 learned_addr learned my addr 172.21.15.164:0/871868521 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:01.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b3400640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b41e7720 0x7fa2b414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 -- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b41e7720 msgr2=0x7fa2b414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b41e7720 0x7fa2b414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 -- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298004d50 msgr2=0x7fa2b415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298004d50 0x7fa2b415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 -- 172.21.15.164:0/871868521 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b4156ee0 con 0x7fa2b41f5010 2024-08-31T12:14:01.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b2000640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0011a50 tx=0x7fa2a0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a001f070 con 0x7fa2b41f5010 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2a000fe80 con 0x7fa2b41f5010 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b4159f40 con 0x7fa2b41f5010 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0012690 con 0x7fa2b41f5010 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.541+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b415a4e0 con 0x7fa2b41f5010 2024-08-31T12:14:01.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.545+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b4152a10 con 0x7fa2b41f5010 2024-08-31T12:14:01.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.545+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa2a0022070 con 0x7fa2b41f5010 2024-08-31T12:14:01.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.545+0000 7fa2aaa00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 0x7fa294074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.545+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa2a0093b90 con 0x7fa2b41f5010 2024-08-31T12:14:01.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.545+0000 7fa2b2a00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 0x7fa294074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.549+0000 7fa2b2a00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 0x7fa294074600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4001870 tx=0x7fa2a4006040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:01.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.549+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa2a005eb30 con 0x7fa2b41f5010 2024-08-31T12:14:01.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.729+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2b41560a0 con 0x7fa2b41f5010 2024-08-31T12:14:01.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.729+0000 7fa2aaa00640 1 -- 172.21.15.164:0/871868521 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fa2a00632f0 con 0x7fa2b41f5010 2024-08-31T12:14:01.733 INFO:teuthology.orchestra.run.smithi164.stderr:listed 0 entries 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 msgr2=0x7fa294074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 0x7fa294074600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4001870 tx=0x7fa2a4006040 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 msgr2=0x7fa2b41569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0011a50 tx=0x7fa2a0011f10 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 shutdown_connections 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa2940720f0 0x7fa294074600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b41e7720 0x7fa2b414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2b41f5010 0x7fa2b41569a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 --2- 172.21.15.164:0/871868521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298004d50 0x7fa2b415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 >> 172.21.15.164:0/871868521 conn(0x7fa2b40ccf20 msgr2=0x7fa2b40714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:01.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 shutdown_connections 2024-08-31T12:14:01.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.733+0000 7fa2b9c00640 1 -- 172.21.15.164:0/871868521 wait complete. 2024-08-31T12:14:01.756 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:14:01.756 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:14:01.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T12:14:01.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- 172.21.15.164:0/44795434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 msgr2=0x7fbe74152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 --2- 172.21.15.164:0/44795434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe74152a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe74070b70 tx=0x7fbe6401eff0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- 172.21.15.164:0/44795434 shutdown_connections 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 --2- 172.21.15.164:0/44795434 >> v2:172.21.15.184:3300/0 conn(0x7fbe740c1f40 0x7fbe740c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 --2- 172.21.15.164:0/44795434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe74152a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- 172.21.15.164:0/44795434 >> 172.21.15.164:0/44795434 conn(0x7fbe740ccf20 msgr2=0x7fbe740cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- 172.21.15.164:0/44795434 shutdown_connections 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- 172.21.15.164:0/44795434 wait complete. 2024-08-31T12:14:01.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 Processor -- start 2024-08-31T12:14:01.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.961+0000 7fbe7b600640 1 -- start start 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe740c1f40 0x7fbe74154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe740c7920 0x7fbe741e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74074fb0 con 0x7fbe7415bc70 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74074e30 con 0x7fbe740c1f40 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbe740c7d30 con 0x7fbe740c7920 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45148/0 (socket says 172.21.15.164:45148) 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 -- 172.21.15.164:0/1255915070 learned_addr learned my addr 172.21.15.164:0/1255915070 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:01.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe78c00640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe740c1f40 0x7fbe74154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe6be00640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe740c7920 0x7fbe741e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 -- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe740c7920 msgr2=0x7fbe741e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe740c7920 0x7fbe741e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 -- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe740c1f40 msgr2=0x7fbe74154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe740c1f40 0x7fbe74154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:01.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 -- 172.21.15.164:0/1255915070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe741e20c0 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe79600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00caa0 tx=0x7fbe6c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c016020 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe6c00a930 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe741f5720 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00ad80 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe741f5c90 con 0x7fbe7415bc70 2024-08-31T12:14:01.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.965+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe740c9330 con 0x7fbe7415bc70 2024-08-31T12:14:01.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.969+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbe6c019020 con 0x7fbe7415bc70 2024-08-31T12:14:01.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.969+0000 7fbe71600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 0x7fbe500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:01.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.969+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbe6c0932e0 con 0x7fbe7415bc70 2024-08-31T12:14:01.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.969+0000 7fbe78c00640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 0x7fbe500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:01.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.969+0000 7fbe78c00640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 0x7fbe500745d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b2000 tx=0x7fbe6401d830 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:01.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:01.973+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbe6c020020 con 0x7fbe7415bc70 2024-08-31T12:14:02.041 INFO:tasks.ceph.mds.a.smithi164.stderr:2024-08-31T12:14:02.037+0000 7fef5f400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:14:02.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.149+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe74152d30 con 0x7fbe7415bc70 2024-08-31T12:14:02.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.149+0000 7fbe71600640 1 -- 172.21.15.164:0/1255915070 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fbe6c05e310 con 0x7fbe7415bc70 2024-08-31T12:14:02.152 INFO:teuthology.orchestra.run.smithi164.stderr:listed 0 entries 2024-08-31T12:14:02.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 msgr2=0x7fbe500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 0x7fbe500745d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b2000 tx=0x7fbe6401d830 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 msgr2=0x7fbe7414cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00caa0 tx=0x7fbe6c00cb90 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 shutdown_connections 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe500720c0 0x7fbe500745d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe7415bc70 0x7fbe7414cf00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe740c7920 0x7fbe741e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 --2- 172.21.15.164:0/1255915070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe740c1f40 0x7fbe74154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 >> 172.21.15.164:0/1255915070 conn(0x7fbe740ccf20 msgr2=0x7fbe74151840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 shutdown_connections 2024-08-31T12:14:02.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:02.153+0000 7fbe7b600640 1 -- 172.21.15.164:0/1255915070 wait complete. 2024-08-31T12:14:02.174 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi164.front.sepia.ceph.com... 2024-08-31T12:14:02.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:02.175 DEBUG:teuthology.orchestra.run.smithi164:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-31T12:14:02.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi164.stderr:ceph-fuse[35394]: fuse finished with error 0 and tester_r 0 2024-08-31T12:14:02.210 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:14:03.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:14:03.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:14:08.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:14:08.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:08.312 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-31T12:14:08.334 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:08.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 -- 172.21.15.164:0/296596014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2fe0 msgr2=0x7f4b0c1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 --2- 172.21.15.164:0/296596014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2fe0 0x7f4b0c1520f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009900 tx=0x7f4afc01c850 comp rx=0 tx=0).stop 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 -- 172.21.15.164:0/296596014 shutdown_connections 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 --2- 172.21.15.164:0/296596014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2900 0x7f4b0c0c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 --2- 172.21.15.164:0/296596014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2fe0 0x7f4b0c1520f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 -- 172.21.15.164:0/296596014 >> 172.21.15.164:0/296596014 conn(0x7f4b0c0ccf20 msgr2=0x7f4b0c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 -- 172.21.15.164:0/296596014 shutdown_connections 2024-08-31T12:14:08.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.540+0000 7f4b12400640 1 -- 172.21.15.164:0/296596014 wait complete. 2024-08-31T12:14:08.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 Processor -- start 2024-08-31T12:14:08.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- start start 2024-08-31T12:14:08.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2fe0 0x7f4b0c0767a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 0x7f4b0c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c0c8f20 con 0x7f4b0c0b2900 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c158a50 con 0x7f4b0c0c2480 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0c0c90a0 con 0x7f4b0c0b2fe0 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41570/0 (socket says 172.21.15.164:41570) 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 -- 172.21.15.164:0/352572505 learned_addr learned my addr 172.21.15.164:0/352572505 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0aa00640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2fe0 0x7f4b0c0767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0be00640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 0x7f4b0c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 -- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2fe0 msgr2=0x7f4b0c0767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2fe0 0x7f4b0c0767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 -- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 msgr2=0x7f4b0c149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 0x7f4b0c149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 -- 172.21.15.164:0/352572505 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c1f9060 con 0x7f4b0c0b2900 2024-08-31T12:14:08.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0be00640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 0x7f4b0c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b0b400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b0040 tx=0x7f4afc0a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0b2040 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4afc004470 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c1f9270 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0052d0 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.544+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c0c6020 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c0c1f40 con 0x7f4b0c0b2900 2024-08-31T12:14:08.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4afc0be060 con 0x7f4b0c0b2900 2024-08-31T12:14:08.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b03400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 0x7f4aec074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4afc12c870 con 0x7f4b0c0b2900 2024-08-31T12:14:08.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b0aa00640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 0x7f4aec074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.548+0000 7f4b0aa00640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 0x7f4aec074600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c5820 tx=0x7f4af8005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:08.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.552+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4afc0164d0 con 0x7f4b0c0b2900 2024-08-31T12:14:08.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.720+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b0c156460 con 0x7f4b0c0b2900 2024-08-31T12:14:08.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b03400640 1 -- 172.21.15.164:0/352572505 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f4afc0f7d60 con 0x7f4b0c0b2900 2024-08-31T12:14:08.727 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:08.727 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 msgr2=0x7f4aec074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 0x7f4aec074600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c5820 tx=0x7f4af8005860 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 msgr2=0x7f4b0c1f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b0040 tx=0x7f4afc0a5590 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 shutdown_connections 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4aec0720f0 0x7f4aec074600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b0c0c2480 0x7f4b0c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b0c0b2fe0 0x7f4b0c0767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 --2- 172.21.15.164:0/352572505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b0c0b2900 0x7f4b0c1f8b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 >> 172.21.15.164:0/352572505 conn(0x7f4b0c0ccf20 msgr2=0x7f4b0c1574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:08.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 shutdown_connections 2024-08-31T12:14:08.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.724+0000 7f4b12400640 1 -- 172.21.15.164:0/352572505 wait complete. 2024-08-31T12:14:08.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:08.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.896+0000 7fe381400640 1 -- 172.21.15.164:0/2860742863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe360004da0 msgr2=0x7fe360005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.896+0000 7fe381400640 1 --2- 172.21.15.164:0/2860742863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe360004da0 0x7fe360005230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0cadf0 tx=0x7fe37401d590 comp rx=0 tx=0).stop 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.896+0000 7fe37b200640 1 -- 172.21.15.164:0/2860742863 reap_dead start 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- 172.21.15.164:0/2860742863 shutdown_connections 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- 172.21.15.164:0/2860742863 >> 172.21.15.164:0/2860742863 conn(0x7fe37c0ccf20 msgr2=0x7fe37c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- 172.21.15.164:0/2860742863 shutdown_connections 2024-08-31T12:14:08.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- 172.21.15.164:0/2860742863 wait complete. 2024-08-31T12:14:08.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 Processor -- start 2024-08-31T12:14:08.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- start start 2024-08-31T12:14:08.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 0x7fe37c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe37c0c5b50 0x7fe37c149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c074e30 con 0x7fe37c159a50 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c0c8030 con 0x7fe360004da0 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.900+0000 7fe381400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c074fb0 con 0x7fe37c0c5b50 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41594/0 (socket says 172.21.15.164:41594) 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 -- 172.21.15.164:0/3012056818 learned_addr learned my addr 172.21.15.164:0/3012056818 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37a800640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 0x7fe37c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe379e00640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe37c0c5b50 0x7fe37c149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 -- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe37c0c5b50 msgr2=0x7fe37c149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe37c0c5b50 0x7fe37c149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 -- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 msgr2=0x7fe37c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:08.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 0x7fe37c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 -- 172.21.15.164:0/3012056818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c0c5f60 con 0x7fe37c159a50 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37a800640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 0x7fe37c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe37b200640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3740990c0 tx=0x7fe374004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374009a90 con 0x7fe37c159a50 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3740a94d0 con 0x7fe37c159a50 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c0b1a20 con 0x7fe37c159a50 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3740a9cb0 con 0x7fe37c159a50 2024-08-31T12:14:08.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c0c6920 con 0x7fe37c159a50 2024-08-31T12:14:08.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c0c5280 con 0x7fe37c159a50 2024-08-31T12:14:08.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.904+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe374004fc0 con 0x7fe37c159a50 2024-08-31T12:14:08.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.908+0000 7fe372a00640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 0x7fe35c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:08.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.908+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe37412e3f0 con 0x7fe37c159a50 2024-08-31T12:14:08.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.908+0000 7fe37a800640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 0x7fe35c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:08.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.908+0000 7fe37a800640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 0x7fe35c0745d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006fd0 tx=0x7fe36c006b20 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:08.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:08.912+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe3740ad070 con 0x7fe37c159a50 2024-08-31T12:14:09.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.080+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe37c0c2af0 con 0x7fe37c159a50 2024-08-31T12:14:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.080+0000 7fe372a00640 1 -- 172.21.15.164:0/3012056818 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7fe3740172a0 con 0x7fe37c159a50 2024-08-31T12:14:09.085 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:09.085 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 msgr2=0x7fe35c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 0x7fe35c0745d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006fd0 tx=0x7fe36c006b20 comp rx=0 tx=0).stop 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 msgr2=0x7fe37c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3740990c0 tx=0x7fe374004f50 comp rx=0 tx=0).stop 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 shutdown_connections 2024-08-31T12:14:09.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe35c0720c0 0x7fe35c0745d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe37c159a50 0x7fe37c159e60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe37c0c5b50 0x7fe37c149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 --2- 172.21.15.164:0/3012056818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe360004da0 0x7fe37c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 >> 172.21.15.164:0/3012056818 conn(0x7fe37c0ccf20 msgr2=0x7fe37c1e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 shutdown_connections 2024-08-31T12:14:09.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.084+0000 7fe381400640 1 -- 172.21.15.164:0/3012056818 wait complete. 2024-08-31T12:14:09.108 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-31T12:14:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 -- 172.21.15.164:0/2019909913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b60004810 msgr2=0x7f9b60004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 --2- 172.21.15.164:0/2019909913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b60004810 0x7f9b60004c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009b40 tx=0x7f9b6401d270 comp rx=0 tx=0).stop 2024-08-31T12:14:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b7e600640 1 -- 172.21.15.164:0/2019909913 reap_dead start 2024-08-31T12:14:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 -- 172.21.15.164:0/2019909913 shutdown_connections 2024-08-31T12:14:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 -- 172.21.15.164:0/2019909913 >> 172.21.15.164:0/2019909913 conn(0x7f9b780ca360 msgr2=0x7f9b780ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 -- 172.21.15.164:0/2019909913 shutdown_connections 2024-08-31T12:14:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.260+0000 7f9b80600640 1 -- 172.21.15.164:0/2019909913 wait complete. 2024-08-31T12:14:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 Processor -- start 2024-08-31T12:14:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- start start 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b60004810 0x7f9b781f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b78156810 0x7f9b7814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9b78073570 con 0x7f9b78156c20 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9b78159220 con 0x7f9b60004810 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9b780cae80 con 0x7f9b78156810 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41612/0 (socket says 172.21.15.164:41612) 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 -- 172.21.15.164:0/2279024137 learned_addr learned my addr 172.21.15.164:0/2279024137 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7dc00640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b60004810 0x7f9b781f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7d200640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b78156810 0x7f9b7814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 -- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b78156810 msgr2=0x7f9b7814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b78156810 0x7f9b7814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 -- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b60004810 msgr2=0x7f9b781f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b60004810 0x7f9b781f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 -- 172.21.15.164:0/2279024137 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b781f2990 con 0x7f9b78156c20 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b7e600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9b780c6d70 tx=0x7f9b70001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70015020 con 0x7f9b78156c20 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b70010980 con 0x7f9b78156c20 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70010dd0 con 0x7f9b78156c20 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b780c9190 con 0x7f9b78156c20 2024-08-31T12:14:09.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.264+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b781470a0 con 0x7f9b78156c20 2024-08-31T12:14:09.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.268+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b78069030 con 0x7f9b78156c20 2024-08-31T12:14:09.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.268+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9b70018020 con 0x7f9b78156c20 2024-08-31T12:14:09.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.268+0000 7f9b75600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 0x7f9b580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.268+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9b70093830 con 0x7f9b78156c20 2024-08-31T12:14:09.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.268+0000 7f9b7dc00640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 0x7f9b580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.272+0000 7f9b7dc00640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 0x7f9b580745d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c001870 tx=0x7f9b6c000bd0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:09.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.272+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9b7001f020 con 0x7f9b78156c20 2024-08-31T12:14:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.472+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9b781561f0 con 0x7f9b78156c20 2024-08-31T12:14:09.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.624+0000 7f9b75600640 1 -- 172.21.15.164:0/2279024137 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f9b700672e0 con 0x7f9b78156c20 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 msgr2=0x7f9b580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 0x7f9b580745d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c001870 tx=0x7f9b6c000bd0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 msgr2=0x7f9b7814d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9b780c6d70 tx=0x7f9b70001b90 comp rx=0 tx=0).stop 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 shutdown_connections 2024-08-31T12:14:09.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9b580720c0 0x7f9b580745d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b78156c20 0x7f9b7814d2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b78156810 0x7f9b7814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 --2- 172.21.15.164:0/2279024137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b60004810 0x7f9b781f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 >> 172.21.15.164:0/2279024137 conn(0x7f9b780ca360 msgr2=0x7f9b781e3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 shutdown_connections 2024-08-31T12:14:09.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.628+0000 7f9b80600640 1 -- 172.21.15.164:0/2279024137 wait complete. 2024-08-31T12:14:09.652 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300} 2024-08-31T12:14:09.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-31T12:14:09.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 -- 172.21.15.164:0/1307554684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 msgr2=0x7f3a1c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 --2- 172.21.15.164:0/1307554684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c15a120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0b31d0 tx=0x7f3a0c01c8c0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 -- 172.21.15.164:0/1307554684 shutdown_connections 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 --2- 172.21.15.164:0/1307554684 >> v2:172.21.15.184:3300/0 conn(0x7f3a1c06f3f0 0x7f3a1c06f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 --2- 172.21.15.164:0/1307554684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c15a120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 -- 172.21.15.164:0/1307554684 >> 172.21.15.164:0/1307554684 conn(0x7f3a1c0c99b0 msgr2=0x7f3a1c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 -- 172.21.15.164:0/1307554684 shutdown_connections 2024-08-31T12:14:09.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.808+0000 7f3a21200640 1 -- 172.21.15.164:0/1307554684 wait complete. 2024-08-31T12:14:09.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 Processor -- start 2024-08-31T12:14:09.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 -- start start 2024-08-31T12:14:09.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a1c06f3f0 0x7f3a1c157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a1c153800 0x7f3a1c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c073e70 con 0x7f3a1c074d50 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c073b90 con 0x7f3a1c06f3f0 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a21200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1c069fc0 con 0x7f3a1c153800 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41618/0 (socket says 172.21.15.164:41618) 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 -- 172.21.15.164:0/3201891592 learned_addr learned my addr 172.21.15.164:0/3201891592 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a19e00640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a1c06f3f0 0x7f3a1c157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a1a800640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a1c153800 0x7f3a1c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 -- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a1c153800 msgr2=0x7f3a1c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a1c153800 0x7f3a1c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 -- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a1c06f3f0 msgr2=0x7f3a1c157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a1c06f3f0 0x7f3a1c157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 -- 172.21.15.164:0/3201891592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c14f2a0 con 0x7f3a1c074d50 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a11400640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c3f0 tx=0x7f3a0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04017070 con 0x7f3a1c074d50 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.812+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a040053c0 con 0x7f3a1c074d50 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c14e350 con 0x7f3a1c074d50 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04003860 con 0x7f3a1c074d50 2024-08-31T12:14:09.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c14dd90 con 0x7f3a1c074d50 2024-08-31T12:14:09.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c153c10 con 0x7f3a1c074d50 2024-08-31T12:14:09.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3a0401a070 con 0x7f3a1c074d50 2024-08-31T12:14:09.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a12a00640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 0x7f39f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:09.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3a04092290 con 0x7f3a1c074d50 2024-08-31T12:14:09.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.816+0000 7f3a19e00640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 0x7f39f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:09.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.820+0000 7f3a19e00640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 0x7f39f80745d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0af000 tx=0x7f3a0c01b100 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:09.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:09.820+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3a0405d120 con 0x7f3a1c074d50 2024-08-31T12:14:10.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.020+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3a1c0b2c10 con 0x7f3a1c074d50 2024-08-31T12:14:10.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.640+0000 7f3a12a00640 1 -- 172.21.15.164:0/3201891592 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f3a040618e0 con 0x7f3a1c074d50 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 msgr2=0x7f39f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 0x7f39f80745d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0af000 tx=0x7f3a0c01b100 comp rx=0 tx=0).stop 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 msgr2=0x7f3a1c14ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c3f0 tx=0x7f3a0400c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 shutdown_connections 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39f80720c0 0x7f39f80745d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a1c153800 0x7f3a1c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c074d50 0x7f3a1c14ed60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 --2- 172.21.15.164:0/3201891592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a1c06f3f0 0x7f3a1c157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 >> 172.21.15.164:0/3201891592 conn(0x7f3a1c0c99b0 msgr2=0x7f3a1c1474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:10.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 shutdown_connections 2024-08-31T12:14:10.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.644+0000 7f3a21200640 1 -- 172.21.15.164:0/3201891592 wait complete. 2024-08-31T12:14:10.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-08-31T12:14:10.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 -- 172.21.15.164:0/3668508692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 msgr2=0x7f89d000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:10.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 --2- 172.21.15.164:0/3668508692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89d000b9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c610 tx=0x7f89e001d2a0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 -- 172.21.15.164:0/3668508692 shutdown_connections 2024-08-31T12:14:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 --2- 172.21.15.164:0/3668508692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89d000b9d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 -- 172.21.15.164:0/3668508692 >> 172.21.15.164:0/3668508692 conn(0x7f89e806ce00 msgr2=0x7f89e806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 -- 172.21.15.164:0/3668508692 shutdown_connections 2024-08-31T12:14:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.828+0000 7f89ede00640 1 -- 172.21.15.164:0/3668508692 wait complete. 2024-08-31T12:14:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 Processor -- start 2024-08-31T12:14:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 -- start start 2024-08-31T12:14:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89e8073130 0x7f89e8146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89e8073540 0x7f89e8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89e80cb420 con 0x7f89d0005260 2024-08-31T12:14:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8159cc0 con 0x7f89e8073540 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ede00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f89e80cb5a0 con 0x7f89e8073130 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41634/0 (socket says 172.21.15.164:41634) 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 -- 172.21.15.164:0/272034752 learned_addr learned my addr 172.21.15.164:0/272034752 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89e7e00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89e8073130 0x7f89e8146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89ed400640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89e8073540 0x7f89e8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 -- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89e8073130 msgr2=0x7f89e8146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89e8073130 0x7f89e8146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 -- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89e8073540 msgr2=0x7f89e8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89e8073540 0x7f89e8146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 -- 172.21.15.164:0/272034752 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8158ee0 con 0x7f89d0005260 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.832+0000 7f89eca00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89dc004e00 tx=0x7f89dc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc015020 con 0x7f89d0005260 2024-08-31T12:14:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89dc011670 con 0x7f89d0005260 2024-08-31T12:14:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e8159180 con 0x7f89d0005260 2024-08-31T12:14:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc011aa0 con 0x7f89d0005260 2024-08-31T12:14:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e8157770 con 0x7f89d0005260 2024-08-31T12:14:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e81536c0 con 0x7f89d0005260 2024-08-31T12:14:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f89dc018020 con 0x7f89d0005260 2024-08-31T12:14:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 0x7f89c8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f89dc093780 con 0x7f89d0005260 2024-08-31T12:14:10.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.836+0000 7f89e7e00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 0x7f89c8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:10.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.840+0000 7f89e7e00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 0x7f89c8074600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89e8073a80 tx=0x7f89d40091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:10.840+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f89dc01f020 con 0x7f89d0005260 2024-08-31T12:14:11.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.040+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f89e80cfaf0 con 0x7f89d0005260 2024-08-31T12:14:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89e4c00640 1 -- 172.21.15.164:0/272034752 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f89dc067230 con 0x7f89d0005260 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 msgr2=0x7f89c8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 0x7f89c8074600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89e8073a80 tx=0x7f89d40091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 msgr2=0x7f89e806dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89dc004e00 tx=0x7f89dc001640 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 shutdown_connections 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f89c80720f0 0x7f89c8074600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89e8073540 0x7f89e8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89e8073130 0x7f89e8146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 --2- 172.21.15.164:0/272034752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0005260 0x7f89e806dd40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 >> 172.21.15.164:0/272034752 conn(0x7f89e806ce00 msgr2=0x7f89e8151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:11.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 shutdown_connections 2024-08-31T12:14:11.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.652+0000 7f89ede00640 1 -- 172.21.15.164:0/272034752 wait complete. 2024-08-31T12:14:11.680 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-31T12:14:11.680 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:11.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 -- 172.21.15.164:0/2189532003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c0c97e0 msgr2=0x7fcc2c156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:11.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 --2- 172.21.15.164:0/2189532003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c0c97e0 0x7fcc2c156b70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0b5270 tx=0x7fcc1c01c8c0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 -- 172.21.15.164:0/2189532003 shutdown_connections 2024-08-31T12:14:11.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 --2- 172.21.15.164:0/2189532003 >> v2:172.21.15.184:3300/0 conn(0x7fcc2c159f60 0x7fcc2c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 --2- 172.21.15.164:0/2189532003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c0c97e0 0x7fcc2c156b70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 -- 172.21.15.164:0/2189532003 >> 172.21.15.164:0/2189532003 conn(0x7fcc2c071be0 msgr2=0x7fcc2c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:11.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 -- 172.21.15.164:0/2189532003 shutdown_connections 2024-08-31T12:14:11.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.828+0000 7fcc30c00640 1 -- 172.21.15.164:0/2189532003 wait complete. 2024-08-31T12:14:11.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 Processor -- start 2024-08-31T12:14:11.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 -- start start 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc2c0c97e0 0x7fcc2c15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 0x7fcc2c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c0cf610 con 0x7fcc2c159f60 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c0caca0 con 0x7fcc2c0cedf0 2024-08-31T12:14:11.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc30c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c1570b0 con 0x7fcc2c0c97e0 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41662/0 (socket says 172.21.15.164:41662) 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 -- 172.21.15.164:0/534877244 learned_addr learned my addr 172.21.15.164:0/534877244 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc29400640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 0x7fcc2c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc29e00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc2c0c97e0 0x7fcc2c15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 -- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc2c0c97e0 msgr2=0x7fcc2c15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc2c0c97e0 0x7fcc2c15b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 -- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 msgr2=0x7fcc2c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 0x7fcc2c152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc2a800640 1 -- 172.21.15.164:0/534877244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c1534c0 con 0x7fcc2c159f60 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.832+0000 7fcc29400640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 0x7fcc2c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:14:11.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc2a800640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c6e0 tx=0x7fcc2400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:11.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24003b80 con 0x7fcc2c159f60 2024-08-31T12:14:11.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc24003d20 con 0x7fcc2c159f60 2024-08-31T12:14:11.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c15ca80 con 0x7fcc2c159f60 2024-08-31T12:14:11.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24005330 con 0x7fcc2c159f60 2024-08-31T12:14:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c15cd20 con 0x7fcc2c159f60 2024-08-31T12:14:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2c0c5160 con 0x7fcc2c159f60 2024-08-31T12:14:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fcc240054d0 con 0x7fcc2c159f60 2024-08-31T12:14:11.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 0x7fcc0c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:11.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.836+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcc24092c80 con 0x7fcc2c159f60 2024-08-31T12:14:11.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.840+0000 7fcc29e00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 0x7fcc0c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:11.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.840+0000 7fcc29e00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 0x7fcc0c0745d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0af000 tx=0x7fcc1c01b100 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:11.840+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcc2c15ca80 con 0x7fcc2c159f60 2024-08-31T12:14:12.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc2c0c60b0 con 0x7fcc2c159f60 2024-08-31T12:14:12.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc22000640 1 -- 172.21.15.164:0/534877244 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7fcc2405e280 con 0x7fcc2c159f60 2024-08-31T12:14:12.047 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:12.047 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:12.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 msgr2=0x7fcc0c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 0x7fcc0c0745d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0af000 tx=0x7fcc1c01b100 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 msgr2=0x7fcc2c14fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c6e0 tx=0x7fcc2400cba0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 shutdown_connections 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcc0c0720c0 0x7fcc0c0745d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc2c159f60 0x7fcc2c14fbe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc2c0cedf0 0x7fcc2c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 --2- 172.21.15.164:0/534877244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc2c0c97e0 0x7fcc2c15b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 >> 172.21.15.164:0/534877244 conn(0x7fcc2c071be0 msgr2=0x7fcc2c0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 shutdown_connections 2024-08-31T12:14:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.044+0000 7fcc30c00640 1 -- 172.21.15.164:0/534877244 wait complete. 2024-08-31T12:14:12.070 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 -- 172.21.15.164:0/3360373539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df4159f60 msgr2=0x7f5df415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 --2- 172.21.15.164:0/3360373539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df4159f60 0x7f5df415a370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009c80 tx=0x7f5ddc01cda0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 -- 172.21.15.164:0/3360373539 shutdown_connections 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 --2- 172.21.15.164:0/3360373539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df4159f60 0x7f5df415a370 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 --2- 172.21.15.164:0/3360373539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df40cedf0 0x7f5df40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 -- 172.21.15.164:0/3360373539 >> 172.21.15.164:0/3360373539 conn(0x7f5df4071be0 msgr2=0x7f5df406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.216+0000 7f5dfa600640 1 -- 172.21.15.164:0/3360373539 shutdown_connections 2024-08-31T12:14:12.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 -- 172.21.15.164:0/3360373539 wait complete. 2024-08-31T12:14:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 Processor -- start 2024-08-31T12:14:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 -- start start 2024-08-31T12:14:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df40cedf0 0x7f5df41f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df4159f60 0x7f5df406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41596f0 con 0x7f5df40c97e0 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5df408cff0 con 0x7f5df40cedf0 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5dfa600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5df40c5160 con 0x7f5df4159f60 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5df3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5df3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41690/0 (socket says 172.21.15.164:41690) 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.220+0000 7f5df3400640 1 -- 172.21.15.164:0/1164094843 learned_addr learned my addr 172.21.15.164:0/1164094843 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5deaa00640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df40cedf0 0x7f5df41f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3e00640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df4159f60 0x7f5df406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 -- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df4159f60 msgr2=0x7f5df406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df4159f60 0x7f5df406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 -- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df40cedf0 msgr2=0x7f5df41f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df40cedf0 0x7f5df41f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 -- 172.21.15.164:0/1164094843 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df41f4c80 con 0x7f5df40c97e0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5df3400640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c3f0 tx=0x7f5de400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4017070 con 0x7f5df40c97e0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de40053c0 con 0x7f5df40c97e0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df4152460 con 0x7f5df40c97e0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4003860 con 0x7f5df40c97e0 2024-08-31T12:14:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df4152a20 con 0x7f5df40c97e0 2024-08-31T12:14:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df40c5d30 con 0x7f5df40c97e0 2024-08-31T12:14:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.224+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5de401a070 con 0x7f5df40c97e0 2024-08-31T12:14:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.228+0000 7f5debe00640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 0x7f5dd00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.228+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5de40921b0 con 0x7f5df40c97e0 2024-08-31T12:14:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.228+0000 7f5deaa00640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 0x7f5dd00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.228+0000 7f5deaa00640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 0x7f5dd00745d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0af000 tx=0x7f5ddc01b5e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.232+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5de405d7b0 con 0x7f5df40c97e0 2024-08-31T12:14:12.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.396+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5df40703c0 con 0x7f5df40c97e0 2024-08-31T12:14:12.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.396+0000 7f5debe00640 1 -- 172.21.15.164:0/1164094843 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f5de405d0b0 con 0x7f5df40c97e0 2024-08-31T12:14:12.402 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:12.402 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:12.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 msgr2=0x7f5dd00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 0x7f5dd00745d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0af000 tx=0x7f5ddc01b5e0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 msgr2=0x7f5df4150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c3f0 tx=0x7f5de400c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 shutdown_connections 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5dd00720c0 0x7f5dd00745d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df4159f60 0x7f5df406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df40cedf0 0x7f5df41f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 --2- 172.21.15.164:0/1164094843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5df40c97e0 0x7f5df4150680 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 >> 172.21.15.164:0/1164094843 conn(0x7f5df4071be0 msgr2=0x7f5df4162220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 shutdown_connections 2024-08-31T12:14:12.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.400+0000 7f5dfa600640 1 -- 172.21.15.164:0/1164094843 wait complete. 2024-08-31T12:14:12.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T12:14:12.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:12.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 -- 172.21.15.164:0/175209251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd815d9f0 msgr2=0x7f6bd80cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 --2- 172.21.15.164:0/175209251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd815d9f0 0x7f6bd80cee10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8154040 tx=0x7f6bd001f580 comp rx=0 tx=0).stop 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 -- 172.21.15.164:0/175209251 shutdown_connections 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 --2- 172.21.15.164:0/175209251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd815d9f0 0x7f6bd80cee10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 --2- 172.21.15.164:0/175209251 >> v2:172.21.15.184:3300/0 conn(0x7f6bd80ca0e0 0x7f6bd80c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 -- 172.21.15.164:0/175209251 >> 172.21.15.164:0/175209251 conn(0x7f6bd806cc30 msgr2=0x7f6bd806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 -- 172.21.15.164:0/175209251 shutdown_connections 2024-08-31T12:14:12.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.572+0000 7f6bddc00640 1 -- 172.21.15.164:0/175209251 wait complete. 2024-08-31T12:14:12.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 Processor -- start 2024-08-31T12:14:12.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 -- start start 2024-08-31T12:14:12.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bd80ca930 0x7f6bd8147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bd815d9f0 0x7f6bd8147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd80b1c90 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd815d4d0 con 0x7f6bd80ca930 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bddc00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd80cddd0 con 0x7f6bd815d9f0 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41698/0 (socket says 172.21.15.164:41698) 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 -- 172.21.15.164:0/2141797602 learned_addr learned my addr 172.21.15.164:0/2141797602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bcfe00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bd80ca930 0x7f6bd8147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bdd200640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bd815d9f0 0x7f6bd8147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 -- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bd815d9f0 msgr2=0x7f6bd8147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bd815d9f0 0x7f6bd8147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 -- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bd80ca930 msgr2=0x7f6bd8147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bd80ca930 0x7f6bd8147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 -- 172.21.15.164:0/2141797602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd80b4600 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.576+0000 7f6bd7e00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c3f0 tx=0x7f6bc800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8017070 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc80053c0 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8003860 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd81511c0 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd8152f60 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd80ca540 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6bc801a070 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 0x7f6bb4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:12.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6bc80924e0 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.580+0000 7f6bcfe00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 0x7f6bb4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:12.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.584+0000 7f6bcfe00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 0x7f6bb4074600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80ce1d0 tx=0x7f6bc000b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:12.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.584+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6bc8021020 con 0x7f6bd80ca0e0 2024-08-31T12:14:12.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.752+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bd80b1e10 con 0x7f6bb40720f0 2024-08-31T12:14:12.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.772+0000 7f6bd4c00640 1 -- 172.21.15.164:0/2141797602 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f6bc0010b40 con 0x7f6bb40720f0 2024-08-31T12:14:12.778 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:12.780 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 msgr2=0x7f6bb4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 0x7f6bb4074600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80ce1d0 tx=0x7f6bc000b2e0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 msgr2=0x7f6bd80c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c3f0 tx=0x7f6bc800c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 shutdown_connections 2024-08-31T12:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6bb40720f0 0x7f6bb4074600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bd815d9f0 0x7f6bd8147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bd80ca930 0x7f6bd8147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 --2- 172.21.15.164:0/2141797602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bd80ca0e0 0x7f6bd80c4f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 >> 172.21.15.164:0/2141797602 conn(0x7f6bd806cc30 msgr2=0x7f6bd81536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 shutdown_connections 2024-08-31T12:14:12.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.776+0000 7f6bddc00640 1 -- 172.21.15.164:0/2141797602 wait complete. 2024-08-31T12:14:12.799 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-08-31T12:14:12.539445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005732"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:01.323202+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:01.323202+0000","last_peered":"2024-08-31T12:14:01.323202+0000","last_clean":"2024-08-31T12:14:01.323202+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:01.323202+0000","last_undegraded":"2024-08-31T12:14:01.323202+0000","last_fullsized":"2024-08-31T12:14:01.323202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:12.805 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:12.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- 172.21.15.164:0/1127604394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15d220 msgr2=0x7fb46c164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:12.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 --2- 172.21.15.164:0/1127604394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15d220 0x7fb46c164180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb46c072de0 tx=0x7fb46401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- 172.21.15.164:0/1127604394 shutdown_connections 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 --2- 172.21.15.164:0/1127604394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15d220 0x7fb46c164180 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 --2- 172.21.15.164:0/1127604394 >> v2:172.21.15.184:3300/0 conn(0x7fb46c074e20 0x7fb46c156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- 172.21.15.164:0/1127604394 >> 172.21.15.164:0/1127604394 conn(0x7fb46c0ccf20 msgr2=0x7fb46c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- 172.21.15.164:0/1127604394 shutdown_connections 2024-08-31T12:14:12.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- 172.21.15.164:0/1127604394 wait complete. 2024-08-31T12:14:12.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 Processor -- start 2024-08-31T12:14:12.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.992+0000 7fb470c00640 1 -- start start 2024-08-31T12:14:13.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb46c074e20 0x7fb46c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 0x7fb46c14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c159c90 con 0x7fb46c15ce10 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1599b0 con 0x7fb46c074e20 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c159f70 con 0x7fb46c15d220 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41718/0 (socket says 172.21.15.164:41718) 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 -- 172.21.15.164:0/2416448778 learned_addr learned my addr 172.21.15.164:0/2416448778 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb469e00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb46c074e20 0x7fb46c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb46a800640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 0x7fb46c14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 -- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 msgr2=0x7fb46c14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 0x7fb46c14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 -- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb46c074e20 msgr2=0x7fb46c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb46c074e20 0x7fb46c14cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 -- 172.21.15.164:0/2416448778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c14d3a0 con 0x7fb46c15ce10 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb46a800640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 0x7fb46c14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb461400640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c3f0 tx=0x7fb45400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454017070 con 0x7fb46c15ce10 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb454003600 con 0x7fb46c15ce10 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454003a50 con 0x7fb46c15ce10 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c14d640 con 0x7fb46c15ce10 2024-08-31T12:14:13.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c15ae30 con 0x7fb46c15ce10 2024-08-31T12:14:13.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:12.996+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c071e40 con 0x7fb46c15ce10 2024-08-31T12:14:13.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.000+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb45401a070 con 0x7fb46c15ce10 2024-08-31T12:14:13.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.000+0000 7fb462a00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 0x7fb4480745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.000+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb454092180 con 0x7fb46c15ce10 2024-08-31T12:14:13.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.000+0000 7fb469e00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 0x7fb4480745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.000+0000 7fb469e00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 0x7fb4480745d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e50 tx=0x7fb45c0095e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.004+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb45405d0b0 con 0x7fb46c15ce10 2024-08-31T12:14:13.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.164+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb46c0c94c0 con 0x7fb4480720c0 2024-08-31T12:14:13.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.184+0000 7fb462a00640 1 -- 172.21.15.164:0/2416448778 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fb46c0c94c0 con 0x7fb4480720c0 2024-08-31T12:14:13.190 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:13.192 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 msgr2=0x7fb4480745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 0x7fb4480745d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e50 tx=0x7fb45c0095e0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 msgr2=0x7fb46c15b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c3f0 tx=0x7fb45400c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 shutdown_connections 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4480720c0 0x7fb4480745d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb46c15d220 0x7fb46c14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb46c15ce10 0x7fb46c15b360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 --2- 172.21.15.164:0/2416448778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb46c074e20 0x7fb46c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 >> 172.21.15.164:0/2416448778 conn(0x7fb46c0ccf20 msgr2=0x7fb46c158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:13.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 shutdown_connections 2024-08-31T12:14:13.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.188+0000 7fb470c00640 1 -- 172.21.15.164:0/2416448778 wait complete. 2024-08-31T12:14:13.211 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-08-31T12:14:12.539445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005732"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:01.323202+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:01.323202+0000","last_peered":"2024-08-31T12:14:01.323202+0000","last_clean":"2024-08-31T12:14:01.323202+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:01.323202+0000","last_undegraded":"2024-08-31T12:14:01.323202+0000","last_fullsized":"2024-08-31T12:14:01.323202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:13.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T12:14:13.216 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-31T12:14:13.217 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-31T12:14:13.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 -- 172.21.15.164:0/1354842912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c015ced0 msgr2=0x7f97c015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 --2- 172.21.15.164:0/1354842912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c015ced0 0x7f97c015d2e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009c80 tx=0x7f97b801cda0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 -- 172.21.15.164:0/1354842912 shutdown_connections 2024-08-31T12:14:13.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 --2- 172.21.15.164:0/1354842912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c015ced0 0x7f97c015d2e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 -- 172.21.15.164:0/1354842912 >> 172.21.15.164:0/1354842912 conn(0x7f97c0073630 msgr2=0x7f97c0073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:13.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 -- 172.21.15.164:0/1354842912 shutdown_connections 2024-08-31T12:14:13.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.404+0000 7f97c5c00640 1 -- 172.21.15.164:0/1354842912 wait complete. 2024-08-31T12:14:13.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 Processor -- start 2024-08-31T12:14:13.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- start start 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c00c4790 0x7f97c013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 0x7f97c014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f97c00c3fe0 con 0x7f97c00c4ce0 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97c00cab70 con 0x7f97c00c4790 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f97c0158370 con 0x7f97c015ced0 2024-08-31T12:14:13.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41734/0 (socket says 172.21.15.164:41734) 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 -- 172.21.15.164:0/2766311605 learned_addr learned my addr 172.21.15.164:0/2766311605 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97bea00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c00c4790 0x7f97c013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97bf400640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 0x7f97c014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 -- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 msgr2=0x7f97c014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 0x7f97c014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 -- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c00c4790 msgr2=0x7f97c013f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c00c4790 0x7f97c013f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 -- 172.21.15.164:0/2766311605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c00cc810 con 0x7f97c00c4ce0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97bf400640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 0x7f97c014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97be000640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00c460 tx=0x7f97ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac0052d0 con 0x7f97c00c4ce0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97ac005470 con 0x7f97c00c4ce0 2024-08-31T12:14:13.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c0157ea0 con 0x7f97c00c4ce0 2024-08-31T12:14:13.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac012870 con 0x7f97c00c4ce0 2024-08-31T12:14:13.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.408+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c013e280 con 0x7f97c00c4ce0 2024-08-31T12:14:13.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.412+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c015d2e0 con 0x7f97c00c4ce0 2024-08-31T12:14:13.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.412+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f97ac003600 con 0x7f97c00c4ce0 2024-08-31T12:14:13.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.412+0000 7f97b6a00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 0x7f97a00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.412+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f97ac092b00 con 0x7f97c00c4ce0 2024-08-31T12:14:13.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.412+0000 7f97bea00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 0x7f97a00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.416+0000 7f97bea00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 0x7f97a00745d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000f70 tx=0x7f97b0009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.416+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f97ac05e070 con 0x7f97c00c4ce0 2024-08-31T12:14:13.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f97c0153d40 con 0x7f97c00c4ce0 2024-08-31T12:14:13.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97b6a00640 1 -- 172.21.15.164:0/2766311605 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v32) ==== 86+0+160 (secure 0 0 0) 0x7f97ac05d970 con 0x7f97c00c4ce0 2024-08-31T12:14:13.587 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:13.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 msgr2=0x7f97a00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 0x7f97a00745d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000f70 tx=0x7f97b0009040 comp rx=0 tx=0).stop 2024-08-31T12:14:13.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 msgr2=0x7f97c0157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00c460 tx=0x7f97ac00c920 comp rx=0 tx=0).stop 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 shutdown_connections 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97a00720c0 0x7f97a00745d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97c015ced0 0x7f97c014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97c00c4ce0 0x7f97c0157960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 --2- 172.21.15.164:0/2766311605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c00c4790 0x7f97c013f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 >> 172.21.15.164:0/2766311605 conn(0x7f97c0073630 msgr2=0x7f97c0159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 shutdown_connections 2024-08-31T12:14:13.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.584+0000 7f97c5c00640 1 -- 172.21.15.164:0/2766311605 wait complete. 2024-08-31T12:14:13.609 INFO:teuthology.orchestra.run.smithi164.stdout:[{"version":32,"timestamp":"2024-08-31T12:13:35.140586+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"3116.560189"}]}] 2024-08-31T12:14:13.609 INFO:tasks.ceph_manager:config epoch is 32 2024-08-31T12:14:13.609 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T12:14:13.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-31T12:14:13.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-31T12:14:13.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- 172.21.15.164:0/1263584938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 msgr2=0x7f39401538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 --2- 172.21.15.164:0/1263584938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f39401538e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f394015df30 tx=0x7f393401c890 comp rx=0 tx=0).stop 2024-08-31T12:14:13.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- 172.21.15.164:0/1263584938 shutdown_connections 2024-08-31T12:14:13.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 --2- 172.21.15.164:0/1263584938 >> v2:172.21.15.184:3300/0 conn(0x7f394015ced0 0x7f394015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 --2- 172.21.15.164:0/1263584938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f39401538e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- 172.21.15.164:0/1263584938 >> 172.21.15.164:0/1263584938 conn(0x7f3940073630 msgr2=0x7f3940073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:13.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- 172.21.15.164:0/1263584938 shutdown_connections 2024-08-31T12:14:13.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- 172.21.15.164:0/1263584938 wait complete. 2024-08-31T12:14:13.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 Processor -- start 2024-08-31T12:14:13.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.760+0000 7f3948400640 1 -- start start 2024-08-31T12:14:13.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39400c4790 0x7f394015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f394015ced0 0x7f394015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39400c3fe0 con 0x7f39400c4ce0 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3940153e20 con 0x7f394015ced0 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f394015b1a0 con 0x7f39400c4790 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41744/0 (socket says 172.21.15.164:41744) 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 -- 172.21.15.164:0/260102984 learned_addr learned my addr 172.21.15.164:0/260102984 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:13.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945a00640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39400c4790 0x7f394015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3946400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f394015ced0 0x7f394015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 -- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39400c4790 msgr2=0x7f394015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39400c4790 0x7f394015c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 -- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f394015ced0 msgr2=0x7f394015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f394015ced0 0x7f394015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 -- 172.21.15.164:0/260102984 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394015acd0 con 0x7f39400c4ce0 2024-08-31T12:14:13.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3945000640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c3f0 tx=0x7f392c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c017070 con 0x7f39400c4ce0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f392c0053c0 con 0x7f39400c4ce0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c003860 con 0x7f39400c4ce0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3940162d30 con 0x7f39400c4ce0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3940162720 con 0x7f39400c4ce0 2024-08-31T12:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.764+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39401538e0 con 0x7f39400c4ce0 2024-08-31T12:14:13.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.768+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f392c01a070 con 0x7f39400c4ce0 2024-08-31T12:14:13.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.768+0000 7f393d600640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 0x7f39200745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:13.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.768+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f392c0920f0 con 0x7f39400c4ce0 2024-08-31T12:14:13.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.768+0000 7f3945a00640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 0x7f39200745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:13.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.768+0000 7f3945a00640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 0x7f39200745d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39340af000 tx=0x7f39340a7040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:13.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.772+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f392c001090 con 0x7f39400c4ce0 2024-08-31T12:14:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.976+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f394014da00 con 0x7f39400c4ce0 2024-08-31T12:14:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.980+0000 7f393d600640 1 -- 172.21.15.164:0/260102984 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+184299 (secure 0 0 0) 0x7f392c05d0b0 con 0x7f39400c4ce0 2024-08-31T12:14:13.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:13.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 msgr2=0x7f39200745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 0x7f39200745d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39340af000 tx=0x7f39340a7040 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 msgr2=0x7f394014dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c3f0 tx=0x7f392c00c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 shutdown_connections 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39200720c0 0x7f39200745d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f394015ced0 0x7f394015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39400c4ce0 0x7f394014dc20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 --2- 172.21.15.164:0/260102984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39400c4790 0x7f394015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 >> 172.21.15.164:0/260102984 conn(0x7f3940073630 msgr2=0x7f3940157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 shutdown_connections 2024-08-31T12:14:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:13.984+0000 7f3948400640 1 -- 172.21.15.164:0/260102984 wait complete. 2024-08-31T12:14:14.008 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":5,"flags":0,"active_gid":4132,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1260951868},{"type":"v1","addr":"172.21.15.184:6809","nonce":1260951868}]},"active_addr":"172.21.15.184:6809/1260951868","active_change":"2024-08-31T12:13:26.511935+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4156,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":4045618760}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3589362462}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":360101665}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2417792149}]}]} 2024-08-31T12:14:14.012 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-31T12:14:14.012 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-31T12:14:14.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:14.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 -- 172.21.15.164:0/4279131709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf0159f60 msgr2=0x7f4bf015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 --2- 172.21.15.164:0/4279131709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009840 tx=0x7f4bdc01c820 comp rx=0 tx=0).stop 2024-08-31T12:14:14.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 -- 172.21.15.164:0/4279131709 shutdown_connections 2024-08-31T12:14:14.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 --2- 172.21.15.164:0/4279131709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 --2- 172.21.15.164:0/4279131709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00c97e0 0x7f4bf0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 -- 172.21.15.164:0/4279131709 >> 172.21.15.164:0/4279131709 conn(0x7f4bf0071be0 msgr2=0x7f4bf006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:14.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 -- 172.21.15.164:0/4279131709 shutdown_connections 2024-08-31T12:14:14.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.160+0000 7f4bf5400640 1 -- 172.21.15.164:0/4279131709 wait complete. 2024-08-31T12:14:14.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 Processor -- start 2024-08-31T12:14:14.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 -- start start 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00cedf0 0x7f4bf015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01570b0 con 0x7f4bf00c97e0 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf00cf610 con 0x7f4bf0159f60 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bf5400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf01596f0 con 0x7f4bf00cedf0 2024-08-31T12:14:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bee800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bee800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41766/0 (socket says 172.21.15.164:41766) 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bee800640 1 -- 172.21.15.164:0/3951389839 learned_addr learned my addr 172.21.15.164:0/3951389839 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bede00640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00cedf0 0x7f4bf015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.164+0000 7f4bef200640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 -- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00cedf0 msgr2=0x7f4bf015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00cedf0 0x7f4bf015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 -- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 msgr2=0x7f4bf015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 -- 172.21.15.164:0/3951389839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf006fb10 con 0x7f4bf00c97e0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bef200640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bee800640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4be000db10 tx=0x7f4be000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be0017070 con 0x7f4bf00c97e0 2024-08-31T12:14:14.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4be0004b30 con 0x7f4bf00c97e0 2024-08-31T12:14:14.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be0005020 con 0x7f4bf00c97e0 2024-08-31T12:14:14.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf01560d0 con 0x7f4bf00c97e0 2024-08-31T12:14:14.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf015be30 con 0x7f4bf00c97e0 2024-08-31T12:14:14.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf00c5160 con 0x7f4bf00c97e0 2024-08-31T12:14:14.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4be00051c0 con 0x7f4bf00c97e0 2024-08-31T12:14:14.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 0x7f4bd00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.168+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4be00933d0 con 0x7f4bf00c97e0 2024-08-31T12:14:14.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.172+0000 7f4bede00640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 0x7f4bd00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.172+0000 7f4bede00640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 0x7f4bd00745d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0af000 tx=0x7f4bdc01b060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:14.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.176+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4be0020070 con 0x7f4bf00c97e0 2024-08-31T12:14:14.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.340+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bf01573d0 con 0x7f4bf00c97e0 2024-08-31T12:14:14.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4be6a00640 1 -- 172.21.15.164:0/3951389839 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f4be005e950 con 0x7f4bf00c97e0 2024-08-31T12:14:14.347 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:14.348 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:14.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 msgr2=0x7f4bd00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 0x7f4bd00745d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0af000 tx=0x7f4bdc01b060 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 msgr2=0x7f4bf006f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4be000db10 tx=0x7f4be000b260 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 shutdown_connections 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4bd00720c0 0x7f4bd00745d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0159f60 0x7f4bf015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4bf00cedf0 0x7f4bf015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 --2- 172.21.15.164:0/3951389839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf00c97e0 0x7f4bf006f4a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 >> 172.21.15.164:0/3951389839 conn(0x7f4bf0071be0 msgr2=0x7f4bf0157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 shutdown_connections 2024-08-31T12:14:14.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.344+0000 7f4bf5400640 1 -- 172.21.15.164:0/3951389839 wait complete. 2024-08-31T12:14:14.370 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-31T12:14:14.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- 172.21.15.164:0/2808264611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c15d9f0 msgr2=0x7f727c0cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 --2- 172.21.15.164:0/2808264611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c15d9f0 0x7f727c0cee10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f727c154040 tx=0x7f727401eff0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- 172.21.15.164:0/2808264611 shutdown_connections 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 --2- 172.21.15.164:0/2808264611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c15d9f0 0x7f727c0cee10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 --2- 172.21.15.164:0/2808264611 >> v2:172.21.15.184:3300/0 conn(0x7f727c0ca0e0 0x7f727c0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- 172.21.15.164:0/2808264611 >> 172.21.15.164:0/2808264611 conn(0x7f727c06cc30 msgr2=0x7f727c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- 172.21.15.164:0/2808264611 shutdown_connections 2024-08-31T12:14:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- 172.21.15.164:0/2808264611 wait complete. 2024-08-31T12:14:14.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 Processor -- start 2024-08-31T12:14:14.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.520+0000 7f7281a00640 1 -- start start 2024-08-31T12:14:14.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f727c0ca0e0 0x7f727c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 0x7f727c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f727c0b1c90 con 0x7f727c0ca930 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f727c15d4d0 con 0x7f727c15d9f0 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f727c06ea00 con 0x7f727c0ca0e0 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41790/0 (socket says 172.21.15.164:41790) 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 -- 172.21.15.164:0/1390520214 learned_addr learned my addr 172.21.15.164:0/1390520214 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f727be00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f727c0ca0e0 0x7f727c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281000640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 0x7f727c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 -- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f727c0ca0e0 msgr2=0x7f727c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f727c0ca0e0 0x7f727c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 -- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 msgr2=0x7f727c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 0x7f727c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 -- 172.21.15.164:0/1390520214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c0ced30 con 0x7f727c0ca930 2024-08-31T12:14:14.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281000640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 0x7f727c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7273400640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f726400e7f0 tx=0x7f726400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726400ccc0 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f726400ce80 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264005280 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c144f20 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c06e410 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.524+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c0ccf10 con 0x7f727c0ca930 2024-08-31T12:14:14.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.528+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7264005420 con 0x7f727c0ca930 2024-08-31T12:14:14.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.528+0000 7f7278c00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 0x7f7258074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:14.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.528+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7264093910 con 0x7f727c0ca930 2024-08-31T12:14:14.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.528+0000 7f727be00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 0x7f7258074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:14.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.528+0000 7f727be00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 0x7f7258074600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f726c0012f0 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:14.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.532+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f726405edf0 con 0x7f727c0ca930 2024-08-31T12:14:14.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.700+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f727c0ca540 con 0x7f727c0ca930 2024-08-31T12:14:14.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.700+0000 7f7278c00640 1 -- 172.21.15.164:0/1390520214 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f7264067330 con 0x7f727c0ca930 2024-08-31T12:14:14.705 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:14.706 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 msgr2=0x7f7258074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 0x7f7258074600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f726c0012f0 tx=0x7f726c009040 comp rx=0 tx=0).stop 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 msgr2=0x7f727c1449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f726400e7f0 tx=0x7f726400ecb0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 shutdown_connections 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f72580720f0 0x7f7258074600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f727c15d9f0 0x7f727c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f727c0ca930 0x7f727c1449e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 --2- 172.21.15.164:0/1390520214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f727c0ca0e0 0x7f727c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:14.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 >> 172.21.15.164:0/1390520214 conn(0x7f727c06cc30 msgr2=0x7f727c149b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:14.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 shutdown_connections 2024-08-31T12:14:14.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:14.704+0000 7f7281a00640 1 -- 172.21.15.164:0/1390520214 wait complete. 2024-08-31T12:14:14.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-31T12:14:14.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-31T12:14:14.730 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-31T12:14:14.730 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-31T12:14:14.730 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-31T12:14:14.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-31T12:14:14.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-31T12:14:14.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-31T12:14:15.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 -- 172.21.15.164:0/2601841318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4400395c0 msgr2=0x7fb4400deab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb629000640 1 -- 172.21.15.164:0/1848357887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb624155970 msgr2=0x7fb6240ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb629000640 1 --2- 172.21.15.164:0/1848357887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb624155970 0x7fb6240ca610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb610009900 tx=0x7fb61001c850 comp rx=0 tx=0).stop 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 --2- 172.21.15.164:0/2601841318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4400395c0 0x7fb4400deab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4400553a0 tx=0x7fb43801c830 comp rx=0 tx=0).stop 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 -- 172.21.15.164:0/2601841318 shutdown_connections 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 --2- 172.21.15.164:0/2601841318 >> v2:172.21.15.164:3300/0 conn(0x7fb44000e0b0 0x7fb440007100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 --2- 172.21.15.164:0/2601841318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4400395c0 0x7fb4400deab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 -- 172.21.15.164:0/2601841318 >> 172.21.15.164:0/2601841318 conn(0x7fb440054f30 msgr2=0x7fb440050dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 -- 172.21.15.164:0/3432500584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e2300 msgr2=0x7f32a80df7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 --2- 172.21.15.164:0/3432500584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e2300 0x7f32a80df7f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f32a800e450 tx=0x7f329c01ef30 comp rx=0 tx=0).stop 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 -- 172.21.15.164:0/1822100649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe40003bf0 msgr2=0x7fbe40004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 --2- 172.21.15.164:0/1822100649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe40003bf0 0x7fbe40004040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c051b60 tx=0x7fbe5c09a4d0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5a800640 1 -- 172.21.15.164:0/1822100649 reap_dead start 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 -- 172.21.15.164:0/1822100649 shutdown_connections 2024-08-31T12:14:15.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 -- 172.21.15.164:0/1822100649 >> 172.21.15.164:0/1822100649 conn(0x7fbe5404fe40 msgr2=0x7fbe54050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 -- 172.21.15.164:0/2601841318 shutdown_connections 2024-08-31T12:14:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 -- 172.21.15.164:0/1822100649 shutdown_connections 2024-08-31T12:14:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 -- 172.21.15.164:0/3432500584 shutdown_connections 2024-08-31T12:14:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 --2- 172.21.15.164:0/3432500584 >> v2:172.21.15.184:3300/0 conn(0x7f32a80483b0 0x7f32a80d8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fbe5b200640 1 -- 172.21.15.164:0/1822100649 wait complete. 2024-08-31T12:14:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 --2- 172.21.15.164:0/3432500584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e2300 0x7f32a80df7f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7f32af200640 1 -- 172.21.15.164:0/3432500584 >> 172.21.15.164:0/3432500584 conn(0x7f32a8050fb0 msgr2=0x7f32a80513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb629000640 1 -- 172.21.15.164:0/1848357887 shutdown_connections 2024-08-31T12:14:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb629000640 1 --2- 172.21.15.164:0/1848357887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb624155970 0x7fb6240ca610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fb629000640 1 -- 172.21.15.164:0/1848357887 >> 172.21.15.164:0/1848357887 conn(0x7fb6240726c0 msgr2=0x7fb6240cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fb629000640 1 -- 172.21.15.164:0/1848357887 shutdown_connections 2024-08-31T12:14:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7f32af200640 1 -- 172.21.15.164:0/3432500584 shutdown_connections 2024-08-31T12:14:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.020+0000 7fb44cc00640 1 -- 172.21.15.164:0/2601841318 wait complete. 2024-08-31T12:14:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7f32af200640 1 -- 172.21.15.164:0/3432500584 wait complete. 2024-08-31T12:14:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fb44cc00640 1 Processor -- start 2024-08-31T12:14:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fbe5b200640 1 Processor -- start 2024-08-31T12:14:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fb44cc00640 1 -- start start 2024-08-31T12:14:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fb629000640 1 -- 172.21.15.164:0/1848357887 wait complete. 2024-08-31T12:14:15.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.024+0000 7fbe5b200640 1 -- start start 2024-08-31T12:14:15.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f32af200640 1 Processor -- start 2024-08-31T12:14:15.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f32af200640 1 -- start start 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 -- 172.21.15.164:0/403696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d340dab30 msgr2=0x7f3d34046890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 --2- 172.21.15.164:0/403696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d340dab30 0x7f3d34046890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d3404fd50 tx=0x7f3d30020320 comp rx=0 tx=0).stop 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb440007640 0x7fb4400c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 0x7fb440005580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4400395c0 0x7fb4400dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb44004ee40 con 0x7fb4400395c0 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb44004ecc0 con 0x7fb44000e0b0 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb44cc00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb4400ebc50 con 0x7fb440007640 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 -- 172.21.15.164:0/403696234 shutdown_connections 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 --2- 172.21.15.164:0/403696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d340dab30 0x7f3d34046890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 --2- 172.21.15.164:0/403696234 >> v2:172.21.15.184:3300/0 conn(0x7f3d3400de60 0x7f3d34005c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 -- 172.21.15.164:0/403696234 >> 172.21.15.164:0/403696234 conn(0x7f3d3404fe40 msgr2=0x7f3d34050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe54179da0 0x7fbe540da540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 0x7fbe540dadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe540db330 0x7fbe540e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbe540351f0 con 0x7fbe54179da0 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe54035560 con 0x7fbe540db330 2024-08-31T12:14:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe5b200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbe540451d0 con 0x7fbe540d9de0 2024-08-31T12:14:15.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb629000640 1 Processor -- start 2024-08-31T12:14:15.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f3d43800640 1 -- 172.21.15.164:0/403696234 shutdown_connections 2024-08-31T12:14:15.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe59e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe54179da0 0x7fbe540da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb629000640 1 -- start start 2024-08-31T12:14:15.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb445400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 0x7fb440005580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb445e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb440007640 0x7fb4400c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe59400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 0x7fbe540dadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb445400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 0x7fb440005580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:57984/0 (socket says 172.21.15.164:57984) 2024-08-31T12:14:15.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb445400640 1 -- 172.21.15.164:0/163383491 learned_addr learned my addr 172.21.15.164:0/163383491 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe59400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 0x7fbe540dadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54324/0 (socket says 172.21.15.164:54324) 2024-08-31T12:14:15.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fbe59400640 1 -- 172.21.15.164:0/1279705478 learned_addr learned my addr 172.21.15.164:0/1279705478 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7fb447200640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4400395c0 0x7fb4400dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 -- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe540db330 msgr2=0x7fbe540e85d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T12:14:15.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.028+0000 7f32af200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 0x7f32a80d9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe540db330 0x7fbe540e85d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 -- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe54179da0 msgr2=0x7fbe540da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe54179da0 0x7fbe540da540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe540db740 con 0x7fbe540d9de0 2024-08-31T12:14:15.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f3d43800640 1 -- 172.21.15.164:0/403696234 wait complete. 2024-08-31T12:14:15.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe59400640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 0x7fbe540dadf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c012980 tx=0x7fbe4c012e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c010cd0 con 0x7fbe540d9de0 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe540d8bd0 con 0x7fbe540d9de0 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 -- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb440007640 msgr2=0x7fb4400c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb440007640 0x7fb4400c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 -- 172.21.15.164:0/163383491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4400395c0 msgr2=0x7fb4400dcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4400395c0 0x7fb4400dcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400c8560 con 0x7fb44000e0b0 2024-08-31T12:14:15.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe540d9170 con 0x7fbe540d9de0 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe54033860 con 0x7fbe540d9de0 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 0x7fb6241fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 0x7fb62415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb621e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 0x7fb6241fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb624155970 0x7fb6241693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb621e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 0x7fb6241fd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41870/0 (socket says 172.21.15.164:41870) 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32af200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32a80e2300 0x7f32a802c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32af200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e3010 0x7f32a8046eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32af200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80deff0 con 0x7f32a80e3010 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32af200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80080c0 con 0x7f32a80483b0 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32af200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80077a0 con 0x7f32a80e2300 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ad400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32a80e2300 0x7f32a802c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb445400640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 0x7fb440005580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e970 tx=0x7fb43400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 -- 172.21.15.164:0/2642118654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c2ee0 msgr2=0x7f2d0c155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 --2- 172.21.15.164:0/2642118654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c2ee0 0x7f2d0c155bc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009900 tx=0x7f2cf801c8e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 -- 172.21.15.164:0/296686812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840c8b00 msgr2=0x7f03840c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f0382a00640 1 -- 172.21.15.164:0/296686812 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374008d60 con 0x7f03840c8b00 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 --2- 172.21.15.164:0/296686812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840c8b00 0x7f03840c22b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f03840709e0 tx=0x7f037401c4a0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 -- 172.21.15.164:0/296686812 shutdown_connections 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 --2- 172.21.15.164:0/296686812 >> v2:172.21.15.164:3300/0 conn(0x7f03840b2fd0 0x7f03840c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 --2- 172.21.15.164:0/296686812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840c8b00 0x7f03840c22b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 -- 172.21.15.164:0/296686812 >> 172.21.15.164:0/296686812 conn(0x7f03840ccf20 msgr2=0x7f03840cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 -- 172.21.15.164:0/296686812 shutdown_connections 2024-08-31T12:14:15.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f038b200640 1 -- 172.21.15.164:0/296686812 wait complete. 2024-08-31T12:14:15.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb621400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 0x7fb62415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb621400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 0x7fb62415a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:58000/0 (socket says 172.21.15.164:58000) 2024-08-31T12:14:15.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ad400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32a80e2300 0x7f32a802c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54340/0 (socket says 172.21.15.164:54340) 2024-08-31T12:14:15.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ade00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 0x7f32a80d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ade00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 0x7f32a80d9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:57998/0 (socket says 172.21.15.164:57998) 2024-08-31T12:14:15.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ade00640 1 -- 172.21.15.164:0/2998533944 learned_addr learned my addr 172.21.15.164:0/2998533944 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43400cd20 con 0x7fb44000e0b0 2024-08-31T12:14:15.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb434004020 con 0x7fb44000e0b0 2024-08-31T12:14:15.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb621e00640 1 -- 172.21.15.164:0/2587146324 learned_addr learned my addr 172.21.15.164:0/2587146324 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e3010 0x7f32a8046eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434004470 con 0x7fb44000e0b0 2024-08-31T12:14:15.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb622800640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb624155970 0x7fb6241693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb624155f00 con 0x7fb6240c8580 2024-08-31T12:14:15.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb624155d80 con 0x7fb6240cab50 2024-08-31T12:14:15.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb62415d6a0 con 0x7fb624155970 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 -- 172.21.15.164:0/2642118654 shutdown_connections 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 --2- 172.21.15.164:0/2642118654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c071540 0x7f2d0c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 --2- 172.21.15.164:0/2642118654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c2ee0 0x7f2d0c155bc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 -- 172.21.15.164:0/2642118654 >> 172.21.15.164:0/2642118654 conn(0x7f2d0c0ca9c0 msgr2=0x7f2d0c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 -- 172.21.15.164:0/2642118654 shutdown_connections 2024-08-31T12:14:15.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 -- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32a80e2300 msgr2=0x7f32a802c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32a80e2300 0x7f32a802c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 -- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 msgr2=0x7f32a80d9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 0x7f32a80d9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ae800640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a80d9560 con 0x7f32a80e3010 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe4c017030 con 0x7fbe540d9de0 2024-08-31T12:14:15.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f32ade00640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32a80483b0 0x7f32a80d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.032+0000 7f2d12000640 1 -- 172.21.15.164:0/2642118654 wait complete. 2024-08-31T12:14:15.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 -- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb624155970 msgr2=0x7fb6241693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb624155970 0x7fb6241693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 -- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 msgr2=0x7fb6241fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 0x7fb6241fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241fd7c0 con 0x7fb6240cab50 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621e00640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6240c8580 0x7fb6241fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb622800640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb624155970 0x7fb6241693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:15.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32ae800640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e3010 0x7f32a8046eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32b0051b60 tx=0x7f32b006a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb621400640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 0x7fb62415a9e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6240ce540 tx=0x7fb610005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 -- 172.21.15.164:0/2472242144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc046560 msgr2=0x7f29cc046970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 Processor -- start 2024-08-31T12:14:15.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 -- start start 2024-08-31T12:14:15.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b009a070 con 0x7f32a80e3010 2024-08-31T12:14:15.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d4a00640 1 -- 172.21.15.164:0/2472242144 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d012a720 con 0x7f29cc046560 2024-08-31T12:14:15.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c010cd0 con 0x7fbe540d9de0 2024-08-31T12:14:15.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32b0076f40 con 0x7f32a80e3010 2024-08-31T12:14:15.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b009a070 con 0x7f32a80e3010 2024-08-31T12:14:15.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 --2- 172.21.15.164:0/2472242144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc046560 0x7f29cc046970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29d006b4a0 tx=0x7f29d009c820 comp rx=0 tx=0).stop 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d3400de60 0x7f3d340dcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d3404b410 0x7f3d340c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 0x7f3d340c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3404bf30 con 0x7f3d3400de60 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3404c610 con 0x7f3d340dab30 2024-08-31T12:14:15.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d43800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3404c0b0 con 0x7f3d3404b410 2024-08-31T12:14:15.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4400c5270 con 0x7fb44000e0b0 2024-08-31T12:14:15.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4400c8c30 con 0x7fb44000e0b0 2024-08-31T12:14:15.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f038b200640 1 Processor -- start 2024-08-31T12:14:15.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f2d12000640 1 Processor -- start 2024-08-31T12:14:15.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a80d7f80 con 0x7f32a80e3010 2024-08-31T12:14:15.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a80d8540 con 0x7f32a80e3010 2024-08-31T12:14:15.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 0x7f3d340c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 0x7f3d340c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:58014/0 (socket says 172.21.15.164:58014) 2024-08-31T12:14:15.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 -- 172.21.15.164:0/3112307002 learned_addr learned my addr 172.21.15.164:0/3112307002 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100bc070 con 0x7fb6240cab50 2024-08-31T12:14:15.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610004340 con 0x7fb6240cab50 2024-08-31T12:14:15.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6241fcac0 con 0x7fb6240cab50 2024-08-31T12:14:15.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f038b200640 1 -- start start 2024-08-31T12:14:15.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241fa3b0 con 0x7fb6240cab50 2024-08-31T12:14:15.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100b2040 con 0x7fb6240cab50 2024-08-31T12:14:15.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 -- 172.21.15.164:0/2472242144 shutdown_connections 2024-08-31T12:14:15.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32a80df7f0 con 0x7f32a80e3010 2024-08-31T12:14:15.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 --2- 172.21.15.164:0/2472242144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc046560 0x7f29cc046970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 -- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d3404b410 msgr2=0x7f3d340c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d3404b410 0x7f3d340c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f3d41800640 1 -- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d3400de60 msgr2=0x7f3d340dcca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 --2- 172.21.15.164:0/2472242144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0dab50 0x7f29cc0d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.036+0000 7f29d8800640 1 -- 172.21.15.164:0/2472242144 >> 172.21.15.164:0/2472242144 conn(0x7f29cc050290 msgr2=0x7f29cc0506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f29d8800640 1 -- 172.21.15.164:0/2472242144 shutdown_connections 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d41800640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d3400de60 0x7f3d340dcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d41800640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d340dd1e0 con 0x7f3d340dab30 2024-08-31T12:14:15.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d41800640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 0x7f3d340c53f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00b440 tx=0x7f3d2c00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb440007100 con 0x7fb44000e0b0 2024-08-31T12:14:15.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f2d12000640 1 -- start start 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840b2fd0 0x7f03840c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 0x7f038414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0384158470 0x7f038414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f03841646d0 con 0x7f03840c8b00 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 0x7f038414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840b2fd0 0x7f03840c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0384164550 con 0x7f03840b2fd0 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f038b200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0384164850 con 0x7f0384158470 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 0x7f038414c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41900/0 (socket says 172.21.15.164:41900) 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840b2fd0 0x7f03840c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:58016/0 (socket says 172.21.15.164:58016) 2024-08-31T12:14:15.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 -- 172.21.15.164:0/882526624 learned_addr learned my addr 172.21.15.164:0/882526624 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0389200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0384158470 0x7f038414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb434003600 con 0x7fb44000e0b0 2024-08-31T12:14:15.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5fc001040 con 0x7fb6240cab50 2024-08-31T12:14:15.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f29d8800640 1 -- 172.21.15.164:0/2472242144 wait complete. 2024-08-31T12:14:15.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbe4c013450 con 0x7fbe540d9de0 2024-08-31T12:14:15.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7fbe52000640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe3c0724f0 0x7fbe3c074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c015030 con 0x7f3d340dab30 2024-08-31T12:14:15.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d2c005a20 con 0x7f3d340dab30 2024-08-31T12:14:15.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c006020 con 0x7f3d340dab30 2024-08-31T12:14:15.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbe4c010ad0 con 0x7fbe540d9de0 2024-08-31T12:14:15.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 -- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0384158470 msgr2=0x7f038414b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0384158470 0x7f038414b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 -- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840b2fd0 msgr2=0x7f03840c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03840b2fd0 0x7f03840c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.040+0000 7f0383400640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384202810 con 0x7f03840c8b00 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f0383400640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 0x7f038414c540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f037000a870 tx=0x7f037000ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe52000640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7fbe3c07c8d0 0x7fbe3c07edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb610003860 con 0x7fb6240cab50 2024-08-31T12:14:15.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe3c07f490 con 0x7fbe3c07c8d0 2024-08-31T12:14:15.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb43e000640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4280722f0 0x7fb428074800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe4c05e2a0 con 0x7fbe540d9de0 2024-08-31T12:14:15.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f3d43800640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d340495a0 con 0x7f3d340dab30 2024-08-31T12:14:15.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb434004210 con 0x7fb44000e0b0 2024-08-31T12:14:15.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d0c071540 0x7f2d0c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 0x7f2d0c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c88c0 0x7f2d0c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c168c80 con 0x7f2d0c0c88c0 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c15cac0 con 0x7f2d0c071540 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c168e00 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe59e00640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe3c0724f0 0x7fbe3c074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f3d43800640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d340c73e0 con 0x7f3d340dab30 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb43e000640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7fb42807ba30 0x7fb42807dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb42807e590 con 0x7fb42807ba30 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb434093ee0 con 0x7fb44000e0b0 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 0x7f2d0c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 0x7f2d0c15aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54384/0 (socket says 172.21.15.164:54384) 2024-08-31T12:14:15.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 -- 172.21.15.164:0/643269241 learned_addr learned my addr 172.21.15.164:0/643269241 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb447200640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7fb42807ba30 0x7fb42807dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f29d8800640 1 Processor -- start 2024-08-31T12:14:15.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f29d8800640 1 -- start start 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe5a800640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7fbe3c07c8d0 0x7fbe3c07edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe59e00640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe3c0724f0 0x7fbe3c074a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe400055b0 tx=0x7fbe40005840 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d14001040 con 0x7f3d340dab30 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 -- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d0c071540 msgr2=0x7f2d0c0cd4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d0c071540 0x7f2d0c0cd4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 -- 172.21.15.164:0/643269241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c88c0 msgr2=0x7f2d0c15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0c88c0 0x7f2d0c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c15cf40 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb447200640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7fb42807ba30 0x7fb42807dec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d0aa00640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 0x7f2d0c15aeb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400ebf0 tx=0x7f2d0400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010430 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d040106c0 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010ad0 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fbe5a800640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7fbe3c07c8d0 0x7fbe3c07edc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c142de0 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c15d220 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb445e00640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4280722f0 0x7fb428074800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.044+0000 7fb61a000640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb604072190 0x7fb6040746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb621e00640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb604072190 0x7fb6040746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== osd.4 v2:172.21.15.184:6800/4127972505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb42807e590 con 0x7fb42807ba30 2024-08-31T12:14:15.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d0c0c4760 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f32b00953f0 con 0x7f32a80e3010 2024-08-31T12:14:15.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb61012d1b0 con 0x7fb6240cab50 2024-08-31T12:14:15.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb445e00640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4280722f0 0x7fb428074800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb4380af000 tx=0x7fb43801b070 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700079b0 con 0x7f03840c8b00 2024-08-31T12:14:15.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0370007b50 con 0x7f03840c8b00 2024-08-31T12:14:15.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370005020 con 0x7f03840c8b00 2024-08-31T12:14:15.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03840c4320 con 0x7f03840c8b00 2024-08-31T12:14:15.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb61a000640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7fb60407b950 0x7fb60407dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0384201a50 con 0x7f03840c8b00 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f32900722c0 0x7f32900747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f32b01109d0 con 0x7f32a80e3010 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f329007ba80 0x7f329007df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32ade00640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f32900722c0 0x7f32900747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32b008fe50 con 0x7f329007ba80 2024-08-31T12:14:15.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32b0110dc0 con 0x7f32a80e3010 2024-08-31T12:14:15.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03840ab400 con 0x7f03840c8b00 2024-08-31T12:14:15.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb621e00640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb604072190 0x7fb6040746a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb614001c60 tx=0x7fb614009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== osd.0 v2:172.21.15.164:6808/624071425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe3c07f490 con 0x7fbe3c07c8d0 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3d2c018070 con 0x7f3d340dab30 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d20072110 0x7f3d20074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d2c093080 con 0x7f3d340dab30 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7f3d2007b8d0 0x7f3d2007dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d2c008ed0 con 0x7f3d2007b8d0 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d2c093430 con 0x7f3d340dab30 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d40e00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d20072110 0x7f3d20074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d3be00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7f3d2007b8d0 0x7f3d2007dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6100c7ea0 con 0x7fb60407b950 2024-08-31T12:14:15.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb61012d5a0 con 0x7fb6240cab50 2024-08-31T12:14:15.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7fb622800640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7fb60407b950 0x7fb60407dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f32ade00640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f32900722c0 0x7f32900747d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007fd0 tx=0x7f32a0007f60 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f3d3be00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7f3d2007b8d0 0x7f3d2007dd60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.048+0000 7f29d8800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0456d0 0x7f29cc0067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f3d40e00640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d20072110 0x7f3d20074620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c06b890 tx=0x7f3d3c06ac10 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29cc046560 0x7f29cc047590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 0x7f29cc0d77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0456d0 0x7f29cc0067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 0x7f29cc0d77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 0x7f29cc0d77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:58026/0 (socket says 172.21.15.164:58026) 2024-08-31T12:14:15.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d6800640 1 -- 172.21.15.164:0/2592622166 learned_addr learned my addr 172.21.15.164:0/2592622166 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7fb622800640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7fb60407b950 0x7fb60407dde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc0451b0 con 0x7f29cc046560 2024-08-31T12:14:15.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc0defc0 con 0x7f29cc0dab50 2024-08-31T12:14:15.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc0de140 con 0x7f29cc0456d0 2024-08-31T12:14:15.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== osd.3 v2:172.21.15.164:6800/2906760086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d2c008ed0 con 0x7f3d2007b8d0 2024-08-31T12:14:15.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 -- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 msgr2=0x7f29cc0d77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 0x7f29cc0d77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 -- 172.21.15.164:0/2592622166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29cc046560 msgr2=0x7f29cc047590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29cc046560 0x7f29cc047590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc04a800 con 0x7f29cc0456d0 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d6800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29cc0dab50 0x7f29cc0d77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== osd.1 v2:172.21.15.164:6816/1467060278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6100c7ea0 con 0x7fb60407b950 2024-08-31T12:14:15.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2d04010c70 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2cec0720c0 0x7f2cec0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2d04094480 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f2cec07b800 0x7f2cec07dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d04027e50 con 0x7f2cec07b800 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2d04094870 con 0x7f2d0c0c2ee0 2024-08-31T12:14:15.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d5e00640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0456d0 0x7f29cc0067e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009500 tx=0x7f29c40099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d0be00640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f2cec07b800 0x7f2cec07dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f2d0b400640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2cec0720c0 0x7f2cec0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4013790 con 0x7f29cc0456d0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c4019070 con 0x7f29cc0456d0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.052+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc04aae0 con 0x7f29cc0456d0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4013b90 con 0x7f29cc0456d0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc006380 con 0x7f29cc0456d0 2024-08-31T12:14:15.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f32ad400640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f329007ba80 0x7f329007df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f2d0be00640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f2cec07b800 0x7f2cec07dc90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f2d0b400640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2cec0720c0 0x7f2cec0745d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80af000 tx=0x7f2cf801b120 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29cc032a00 con 0x7f29cc0456d0 2024-08-31T12:14:15.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f32ad400640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f329007ba80 0x7f329007df10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f03700051c0 con 0x7f03840c8b00 2024-08-31T12:14:15.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== osd.2 v2:172.21.15.164:6824/3066810189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32b008fe50 con 0x7f329007ba80 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f037be00640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0364072110 0x7f0364074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0370093470 con 0x7f03840c8b00 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.056+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== osd.5 v2:172.21.15.184:6810/3751959683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d04027e50 con 0x7f2cec07b800 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f037be00640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7f036407b8d0 0x7f036407dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f037001fe50 con 0x7f036407b8d0 2024-08-31T12:14:15.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0370093950 con 0x7f03840c8b00 2024-08-31T12:14:15.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f29c401e460 con 0x7f29cc0456d0 2024-08-31T12:14:15.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f0383e00640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0364072110 0x7f0364074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f0383e00640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0364072110 0x7f0364074620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03740ad000 tx=0x7f037400ac00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f0389200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7f036407b8d0 0x7f036407dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f29b40720c0 0x7f29b40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f29c4093ca0 con 0x7f29cc0456d0 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7f29b407b810 0x7f29b407dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29b407e370 con 0x7f29b407b810 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f29c4094090 con 0x7f29cc0456d0 2024-08-31T12:14:15.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f0389200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7f036407b8d0 0x7f036407dd60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29d6800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7f29b407b810 0x7f29b407dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29d5400640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f29b40720c0 0x7f29b40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.060+0000 7f29d6800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7f29b407b810 0x7f29b407dca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.064+0000 7f29d5400640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f29b40720c0 0x7f29b40745d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007fd0 tx=0x7f29c00078e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.064+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== osd.6 v2:172.21.15.184:6826/1165040551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f037001fe50 con 0x7f036407b8d0 2024-08-31T12:14:15.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.064+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== osd.7 v2:172.21.15.184:6818/3185978825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29b407e370 con 0x7f29b407b810 2024-08-31T12:14:15.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.072+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 --> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4400deb20 con 0x7fb42807ba30 2024-08-31T12:14:15.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb43e000640 1 -- 172.21.15.164:0/163383491 <== osd.4 v2:172.21.15.184:6800/4127972505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4400deb20 con 0x7fb42807ba30 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7fb42807ba30 msgr2=0x7fb42807dec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7fb42807ba30 0x7fb42807dec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4280722f0 msgr2=0x7fb428074800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4280722f0 0x7fb428074800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb4380af000 tx=0x7fb43801b070 comp rx=0 tx=0).stop 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 msgr2=0x7fb440005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 --2- 172.21.15.164:0/163383491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb44000e0b0 0x7fb440005580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e970 tx=0x7fb43400ee30 comp rx=0 tx=0).stop 2024-08-31T12:14:15.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb447200640 1 -- 172.21.15.164:0/163383491 reap_dead start 2024-08-31T12:14:15.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 --> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe540dc000 con 0x7fbe3c07c8d0 2024-08-31T12:14:15.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 shutdown_connections 2024-08-31T12:14:15.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 >> 172.21.15.164:0/163383491 conn(0x7fb440054f30 msgr2=0x7fb4400cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 shutdown_connections 2024-08-31T12:14:15.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fb44cc00640 1 -- 172.21.15.164:0/163383491 wait complete. 2024-08-31T12:14:15.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.080+0000 7fbe52000640 1 -- 172.21.15.164:0/1279705478 <== osd.0 v2:172.21.15.164:6808/624071425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe540dc000 con 0x7fbe3c07c8d0 2024-08-31T12:14:15.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7fbe3c07c8d0 msgr2=0x7fbe3c07edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7fbe3c07c8d0 0x7fbe3c07edc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe3c0724f0 msgr2=0x7fbe3c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbe3c0724f0 0x7fbe3c074a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe400055b0 tx=0x7fbe40005840 comp rx=0 tx=0).stop 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 msgr2=0x7fbe540dadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 --2- 172.21.15.164:0/1279705478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe540d9de0 0x7fbe540dadf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c012980 tx=0x7fbe4c012e40 comp rx=0 tx=0).stop 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5a800640 1 -- 172.21.15.164:0/1279705478 reap_dead start 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 shutdown_connections 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 >> 172.21.15.164:0/1279705478 conn(0x7fbe5404fe40 msgr2=0x7fbe540062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 shutdown_connections 2024-08-31T12:14:15.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fbe5b200640 1 -- 172.21.15.164:0/1279705478 wait complete. 2024-08-31T12:14:15.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 --> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d14002de0 con 0x7f3d2007b8d0 2024-08-31T12:14:15.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 --> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5fc002de0 con 0x7fb60407b950 2024-08-31T12:14:15.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 --> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32a80d9730 con 0x7f329007ba80 2024-08-31T12:14:15.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.084+0000 7f3d38c00640 1 -- 172.21.15.164:0/3112307002 <== osd.3 v2:172.21.15.164:6800/2906760086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d14002de0 con 0x7f3d2007b8d0 2024-08-31T12:14:15.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb61a000640 1 -- 172.21.15.164:0/2587146324 <== osd.1 v2:172.21.15.164:6816/1467060278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5fc002de0 con 0x7fb60407b950 2024-08-31T12:14:15.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32a6000640 1 -- 172.21.15.164:0/2998533944 <== osd.2 v2:172.21.15.164:6824/3066810189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32a80d9730 con 0x7f329007ba80 2024-08-31T12:14:15.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 --> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f03840c4670 con 0x7f036407b8d0 2024-08-31T12:14:15.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7fb60407b950 msgr2=0x7fb60407dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7fb60407b950 0x7fb60407dde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7f3d2007b8d0 msgr2=0x7f3d2007dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7f3d2007b8d0 0x7f3d2007dd60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb604072190 msgr2=0x7fb6040746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb604072190 0x7fb6040746a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb614001c60 tx=0x7fb614009040 comp rx=0 tx=0).stop 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 msgr2=0x7fb62415a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 --2- 172.21.15.164:0/2587146324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6240cab50 0x7fb62415a9e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6240ce540 tx=0x7fb610005790 comp rx=0 tx=0).stop 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb622800640 1 -- 172.21.15.164:0/2587146324 reap_dead start 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 shutdown_connections 2024-08-31T12:14:15.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 >> 172.21.15.164:0/2587146324 conn(0x7fb6240726c0 msgr2=0x7fb624157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d20072110 msgr2=0x7f3d20074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d20072110 0x7f3d20074620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c06b890 tx=0x7f3d3c06ac10 comp rx=0 tx=0).stop 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 msgr2=0x7f3d340c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 --2- 172.21.15.164:0/3112307002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d340dab30 0x7f3d340c53f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00b440 tx=0x7f3d2c00b900 comp rx=0 tx=0).stop 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d41800640 1 -- 172.21.15.164:0/3112307002 reap_dead start 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 shutdown_connections 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 >> 172.21.15.164:0/3112307002 conn(0x7f3d3404fe40 msgr2=0x7f3d340c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f037be00640 1 -- 172.21.15.164:0/882526624 <== osd.6 v2:172.21.15.184:6826/1165040551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f03840c4670 con 0x7f036407b8d0 2024-08-31T12:14:15.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 --> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d0c166240 con 0x7f2cec07b800 2024-08-31T12:14:15.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 shutdown_connections 2024-08-31T12:14:15.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7fb629000640 1 -- 172.21.15.164:0/2587146324 wait complete. 2024-08-31T12:14:15.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f329007ba80 msgr2=0x7f329007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f329007ba80 0x7f329007df10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 shutdown_connections 2024-08-31T12:14:15.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f3d2a000640 1 -- 172.21.15.164:0/3112307002 wait complete. 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f32900722c0 msgr2=0x7f32900747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f32900722c0 0x7f32900747d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007fd0 tx=0x7f32a0007f60 comp rx=0 tx=0).stop 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7f036407b8d0 msgr2=0x7f036407dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7f036407b8d0 0x7f036407dd60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e3010 msgr2=0x7f32a8046eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 --2- 172.21.15.164:0/2998533944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32a80e3010 0x7f32a8046eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32b0051b60 tx=0x7f32b006a010 comp rx=0 tx=0).stop 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0364072110 msgr2=0x7f0364074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0364072110 0x7f0364074620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03740ad000 tx=0x7f037400ac00 comp rx=0 tx=0).stop 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 msgr2=0x7f038414c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 --2- 172.21.15.164:0/882526624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03840c8b00 0x7f038414c540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f037000a870 tx=0x7f037000ad30 comp rx=0 tx=0).stop 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f0389200640 1 -- 172.21.15.164:0/882526624 reap_dead start 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 shutdown_connections 2024-08-31T12:14:15.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 >> 172.21.15.164:0/882526624 conn(0x7f03840ccf20 msgr2=0x7f038414e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f2d03400640 1 -- 172.21.15.164:0/643269241 <== osd.5 v2:172.21.15.184:6810/3751959683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d0c166240 con 0x7f2cec07b800 2024-08-31T12:14:15.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 shutdown_connections 2024-08-31T12:14:15.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32ae800640 1 -- 172.21.15.164:0/2998533944 reap_dead start 2024-08-31T12:14:15.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 shutdown_connections 2024-08-31T12:14:15.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.088+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 >> 172.21.15.164:0/2998533944 conn(0x7f32a8050fb0 msgr2=0x7f32a80dcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f038b200640 1 -- 172.21.15.164:0/882526624 wait complete. 2024-08-31T12:14:15.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f2cec07b800 msgr2=0x7f2cec07dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f2cec07b800 0x7f2cec07dc90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2cec0720c0 msgr2=0x7f2cec0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2cec0720c0 0x7f2cec0745d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80af000 tx=0x7f2cf801b120 comp rx=0 tx=0).stop 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 msgr2=0x7f2d0c15aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 --2- 172.21.15.164:0/643269241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d0c0c2ee0 0x7f2d0c15aeb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400ebf0 tx=0x7f2d0400c6a0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d0be00640 1 -- 172.21.15.164:0/643269241 reap_dead start 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 shutdown_connections 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 >> 172.21.15.164:0/643269241 conn(0x7f2d0c0ca9c0 msgr2=0x7f2d0c0721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 shutdown_connections 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 shutdown_connections 2024-08-31T12:14:15.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f32af200640 1 -- 172.21.15.164:0/2998533944 wait complete. 2024-08-31T12:14:15.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f2d12000640 1 -- 172.21.15.164:0/643269241 wait complete. 2024-08-31T12:14:15.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.092+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 --> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29cc16acd0 con 0x7f29b407b810 2024-08-31T12:14:15.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29ca000640 1 -- 172.21.15.164:0/2592622166 <== osd.7 v2:172.21.15.184:6818/3185978825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29cc16acd0 con 0x7f29b407b810 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7f29b407b810 msgr2=0x7f29b407dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7f29b407b810 0x7f29b407dca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f29b40720c0 msgr2=0x7f29b40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f29b40720c0 0x7f29b40745d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007fd0 tx=0x7f29c00078e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0456d0 msgr2=0x7f29cc0067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 --2- 172.21.15.164:0/2592622166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29cc0456d0 0x7f29cc0067e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009500 tx=0x7f29c40099c0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d6800640 1 -- 172.21.15.164:0/2592622166 reap_dead start 2024-08-31T12:14:15.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 shutdown_connections 2024-08-31T12:14:15.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.096+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 >> 172.21.15.164:0/2592622166 conn(0x7f29cc050290 msgr2=0x7f29cc04ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.100+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 shutdown_connections 2024-08-31T12:14:15.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.100+0000 7f29d8800640 1 -- 172.21.15.164:0/2592622166 wait complete. 2024-08-31T12:14:15.127 INFO:teuthology.orchestra.run.smithi164.stdout:55834574860 2024-08-31T12:14:15.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-31T12:14:15.135 INFO:teuthology.orchestra.run.smithi164.stdout:64424509452 2024-08-31T12:14:15.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-31T12:14:15.140 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:15.140 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-31T12:14:15.142 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:15.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-31T12:14:15.145 INFO:teuthology.orchestra.run.smithi164.stdout:64424509450 2024-08-31T12:14:15.145 INFO:teuthology.orchestra.run.smithi164.stdout:64424509452 2024-08-31T12:14:15.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-31T12:14:15.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-31T12:14:15.149 INFO:teuthology.orchestra.run.smithi164.stdout:64424509450 2024-08-31T12:14:15.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-31T12:14:15.156 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:15.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-31T12:14:15.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 -- 172.21.15.164:0/3448542780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43fc005160 msgr2=0x7f43fc00fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 --2- 172.21.15.164:0/3448542780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43fc005160 0x7f43fc00fdd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f441802e9d0 tx=0x7f441809a8a0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f4417400640 1 -- 172.21.15.164:0/3448542780 reap_dead start 2024-08-31T12:14:15.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 -- 172.21.15.164:0/3448542780 shutdown_connections 2024-08-31T12:14:15.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 -- 172.21.15.164:0/3448542780 >> 172.21.15.164:0/3448542780 conn(0x7f441004fe40 msgr2=0x7f4410050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 -- 172.21.15.164:0/3448542780 shutdown_connections 2024-08-31T12:14:15.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.408+0000 7f441d800640 1 -- 172.21.15.164:0/3448542780 wait complete. 2024-08-31T12:14:15.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.412+0000 7f441d800640 1 Processor -- start 2024-08-31T12:14:15.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.412+0000 7f441d800640 1 -- start start 2024-08-31T12:14:15.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 -- 172.21.15.164:0/3495086109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00483b0 msgr2=0x7f74c00d8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 --2- 172.21.15.164:0/3495086109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00483b0 0x7f74c00d8dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009900 tx=0x7f74bc01f0f0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 -- 172.21.15.164:0/3495086109 shutdown_connections 2024-08-31T12:14:15.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 --2- 172.21.15.164:0/3495086109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00483b0 0x7f74c00d8dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 --2- 172.21.15.164:0/3495086109 >> v2:172.21.15.184:3300/0 conn(0x7f74c00e3010 0x7f74c00df7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 -- 172.21.15.164:0/3495086109 >> 172.21.15.164:0/3495086109 conn(0x7f74c0050fb0 msgr2=0x7f74c00513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 -- 172.21.15.164:0/3495086109 shutdown_connections 2024-08-31T12:14:15.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 0x7f44100d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f74cd000640 1 -- 172.21.15.164:0/3495086109 wait complete. 2024-08-31T12:14:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 0x7f44100d3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f4416a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f4416a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54444/0 (socket says 172.21.15.164:54444) 2024-08-31T12:14:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f4416a00640 1 -- 172.21.15.164:0/1732549172 learned_addr learned my addr 172.21.15.164:0/1732549172 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f4416000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 0x7f44100d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f4417400640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 0x7f44100d3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4410046370 con 0x7f44100d6710 2024-08-31T12:14:15.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4410046090 con 0x7f44100d6300 2024-08-31T12:14:15.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.416+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f441004c610 con 0x7f43fc005160 2024-08-31T12:14:15.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 Processor -- start 2024-08-31T12:14:15.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 -- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 msgr2=0x7f44100d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 0x7f44100d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 -- 172.21.15.164:0/1732549172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 msgr2=0x7f44100d3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 0x7f44100d3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410173e70 con 0x7f43fc005160 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416000640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 0x7f44100d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4417400640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 0x7f44100d3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 -- start start 2024-08-31T12:14:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f4416a00640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f440800c500 tx=0x7f440800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080052d0 con 0x7f43fc005160 2024-08-31T12:14:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4408005470 con 0x7f43fc005160 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408012870 con 0x7f43fc005160 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44100d7d00 con 0x7f43fc005160 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44100cff80 con 0x7f43fc005160 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74c00e2300 0x7f74c00e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00e3010 0x7f74c00d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f74c00deff0 con 0x7f74c00483b0 2024-08-31T12:14:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74c00080c0 con 0x7f74c00e2300 2024-08-31T12:14:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f74cd000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f74c00077a0 con 0x7f74c00e3010 2024-08-31T12:14:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f5e40000640 1 -- 172.21.15.164:0/246318999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e380c97e0 msgr2=0x7f5e38156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f5e40000640 1 --2- 172.21.15.164:0/246318999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e380c97e0 0x7f5e38156b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009c80 tx=0x7f5e2c01cda0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.420+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f00052a0 con 0x7f43fc005160 2024-08-31T12:14:15.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00e3010 0x7f74c00d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41954/0 (socket says 172.21.15.164:41954) 2024-08-31T12:14:15.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 -- 172.21.15.164:0/1958194804 learned_addr learned my addr 172.21.15.164:0/1958194804 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74c00e2300 0x7f74c00e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 -- 172.21.15.164:0/246318999 shutdown_connections 2024-08-31T12:14:15.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 --2- 172.21.15.164:0/246318999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e3815a370 0x7f5e38164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 --2- 172.21.15.164:0/246318999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e380c97e0 0x7f5e38156b70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 -- 172.21.15.164:0/246318999 >> 172.21.15.164:0/246318999 conn(0x7f5e38071be0 msgr2=0x7f5e3806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 -- 172.21.15.164:0/246318999 shutdown_connections 2024-08-31T12:14:15.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f5e40000640 1 -- 172.21.15.164:0/246318999 wait complete. 2024-08-31T12:14:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 -- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00e3010 msgr2=0x7f74c00d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00e3010 0x7f74c00d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 -- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74c00e2300 msgr2=0x7f74c00e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74c00e2300 0x7f74c00e10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 -- 172.21.15.164:0/1958194804 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c0045370 con 0x7f74c00483b0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.424+0000 7f74c7400640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74c8066930 tx=0x7f74c80769a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8077020 con 0x7f74c00483b0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74c80752d0 con 0x7f74c00483b0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8095680 con 0x7f74c00483b0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74cd000640 1 -- 172.21.15.164:0/1958194804 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c0050650 con 0x7f74c00483b0 2024-08-31T12:14:15.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74cd000640 1 -- 172.21.15.164:0/1958194804 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c00508f0 con 0x7f74c00483b0 2024-08-31T12:14:15.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 Processor -- start 2024-08-31T12:14:15.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 -- start start 2024-08-31T12:14:15.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4408012a10 con 0x7f43fc005160 2024-08-31T12:14:15.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 0x7f5e380c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f74cd000640 1 -- 172.21.15.164:0/1958194804 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c00df7f0 con 0x7f74c00483b0 2024-08-31T12:14:15.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 0x7f5e38163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5e381570b0 con 0x7f5e38159f60 2024-08-31T12:14:15.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380cac70 con 0x7f5e3815a370 2024-08-31T12:14:15.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e40000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5e381596f0 con 0x7f5e380c97e0 2024-08-31T12:14:15.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f440ea00640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 0x7f43f80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e3d600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e3d600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54498/0 (socket says 172.21.15.164:54498) 2024-08-31T12:14:15.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e3d600640 1 -- 172.21.15.164:0/3820983044 learned_addr learned my addr 172.21.15.164:0/3820983044 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e3e000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 0x7f5e38163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4408092610 con 0x7f43fc005160 2024-08-31T12:14:15.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f5e3cc00640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 0x7f5e380c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.428+0000 7f4416000640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 0x7f43f80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 -- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 msgr2=0x7f5e381f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 -- 172.21.15.164:0/3820983044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 msgr2=0x7f5e380c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 0x7f5e380c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 -- 172.21.15.164:0/3820983044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e381f9380 con 0x7f5e3815a370 2024-08-31T12:14:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3cc00640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 0x7f5e380c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3d600640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f4416000640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 0x7f43f80746d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441004fa20 tx=0x7f44040091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e3e000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 0x7f5e38163370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e380b4470 tx=0x7f5e3000ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f74c809f3f0 con 0x7f74c00483b0 2024-08-31T12:14:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30004220 con 0x7f5e3815a370 2024-08-31T12:14:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3815afa0 con 0x7f5e3815a370 2024-08-31T12:14:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e30005020 con 0x7f5e3815a370 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30005470 con 0x7f5e3815a370 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 -- 172.21.15.164:0/1005271104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0c8b00 msgr2=0x7f2d7c15ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 --2- 172.21.15.164:0/1005271104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c15ef10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009840 tx=0x7f2d7401efd0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 -- 172.21.15.164:0/1005271104 shutdown_connections 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 --2- 172.21.15.164:0/1005271104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c15ef10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 --2- 172.21.15.164:0/1005271104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0b2f00 0x7f2d7c0c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 --2- 172.21.15.164:0/1005271104 >> v2:172.21.15.164:3300/0 conn(0x7f2d7c0c1f40 0x7f2d7c0c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 -- 172.21.15.164:0/1005271104 >> 172.21.15.164:0/1005271104 conn(0x7f2d7c0ccf20 msgr2=0x7f2d7c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 -- 172.21.15.164:0/1005271104 shutdown_connections 2024-08-31T12:14:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 -- 172.21.15.164:0/2060057691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0c7ca0 msgr2=0x7f52cc0c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 --2- 172.21.15.164:0/2060057691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0c7ca0 0x7f52cc0c8cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009840 tx=0x7f52c001c820 comp rx=0 tx=0).stop 2024-08-31T12:14:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f74bb400640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 0x7f74a80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f74c810f6f0 con 0x7f74c00483b0 2024-08-31T12:14:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f2d84200640 1 -- 172.21.15.164:0/1005271104 wait complete. 2024-08-31T12:14:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f74c6a00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 0x7f74a80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3815b560 con 0x7f5e3815a370 2024-08-31T12:14:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 -- 172.21.15.164:0/2060057691 shutdown_connections 2024-08-31T12:14:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 --2- 172.21.15.164:0/2060057691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0c7ca0 0x7f52cc0c8cc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 --2- 172.21.15.164:0/2060057691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0732e0 0x7f52cc151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 -- 172.21.15.164:0/2060057691 >> 172.21.15.164:0/2060057691 conn(0x7f52cc0cca80 msgr2=0x7f52cc0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e380c5d30 con 0x7f5e3815a370 2024-08-31T12:14:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.432+0000 7f52d2a00640 1 -- 172.21.15.164:0/2060057691 shutdown_connections 2024-08-31T12:14:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f52d2a00640 1 -- 172.21.15.164:0/2060057691 wait complete. 2024-08-31T12:14:15.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 Processor -- start 2024-08-31T12:14:15.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f74c6a00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 0x7f74a80745d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ddbd0 tx=0x7f74b4009060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5e3000c7e0 con 0x7f5e3815a370 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 -- start start 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0b2f00 0x7f2d7c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0c1f40 0x7f2d7c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0c8f10 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c15c670 con 0x7f2d7c0b2f00 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d84200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c0c3ec0 con 0x7f2d7c0c1f40 2024-08-31T12:14:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f5e35600640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 0x7f5e180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42002/0 (socket says 172.21.15.164:42002) 2024-08-31T12:14:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 -- 172.21.15.164:0/208728811 learned_addr learned my addr 172.21.15.164:0/208728811 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d81800640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0b2f00 0x7f2d7c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d80e00640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0c1f40 0x7f2d7c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5e30093260 con 0x7f5e3815a370 2024-08-31T12:14:15.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f5e3d600640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 0x7f5e180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 -- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0c1f40 msgr2=0x7f2d7c15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0c1f40 0x7f2d7c15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 -- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0b2f00 msgr2=0x7f2d7c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0b2f00 0x7f2d7c0c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 -- 172.21.15.164:0/208728811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c0c6480 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f2d82200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009790 tx=0x7f2d74004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f52d2a00640 1 Processor -- start 2024-08-31T12:14:15.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.436+0000 7f52d2a00640 1 -- start start 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f5e3d600640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 0x7f5e180745d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c01b450 tx=0x7f5e2c01b5e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 0x7f52cc141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 0x7f52cc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 0x7f52cc143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc0cd720 con 0x7f52cc0732e0 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc0cd5a0 con 0x7f52cc0c8580 2024-08-31T12:14:15.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc06ed70 con 0x7f52cc0c7ca0 2024-08-31T12:14:15.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4408020070 con 0x7f43fc005160 2024-08-31T12:14:15.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d0c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 0x7f52cc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d0c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 0x7f52cc0c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54516/0 (socket says 172.21.15.164:54516) 2024-08-31T12:14:15.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d0c00640 1 -- 172.21.15.164:0/30776389 learned_addr learned my addr 172.21.15.164:0/30776389 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d2000640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 0x7f52cc143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 0x7f52cc141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f11c2000640 1 -- 172.21.15.164:0/1775415367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc0b2fd0 msgr2=0x7f11bc0c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f11c2000640 1 --2- 172.21.15.164:0/1775415367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc0b2fd0 0x7f11bc0c22b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009870 tx=0x7f11ac01c8a0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f11c2000640 1 -- 172.21.15.164:0/1775415367 shutdown_connections 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f11c2000640 1 --2- 172.21.15.164:0/1775415367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc0b2fd0 0x7f11bc0c22b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f11c2000640 1 -- 172.21.15.164:0/1775415367 >> 172.21.15.164:0/1775415367 conn(0x7f11bc0ccf20 msgr2=0x7f11bc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740be070 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d74005120 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b5040 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c0c72d0 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c0aacc0 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f0696e00640 1 -- 172.21.15.164:0/1949697827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06880d4bb0 msgr2=0x7f067800b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f0696e00640 1 --2- 172.21.15.164:0/1949697827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06880d4bb0 0x7f067800b9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f068400aa10 tx=0x7f068401c930 comp rx=0 tx=0).stop 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f0696400640 1 -- 172.21.15.164:0/1949697827 reap_dead start 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f0696e00640 1 -- 172.21.15.164:0/1949697827 shutdown_connections 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f0696e00640 1 -- 172.21.15.164:0/1949697827 >> 172.21.15.164:0/1949697827 conn(0x7f0688050290 msgr2=0x7f06880506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 -- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 msgr2=0x7f52cc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 0x7f52cc0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 -- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 msgr2=0x7f52cc143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 0x7f52cc143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.440+0000 7f52d1600640 1 -- 172.21.15.164:0/30776389 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc1417c0 con 0x7f52cc0732e0 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52d2000640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 0x7f52cc143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:15.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52d1600640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 0x7f52cc141280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52c400ee00 tx=0x7f52c400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f74c80da6a0 con 0x7f74c00483b0 2024-08-31T12:14:15.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f0696e00640 1 -- 172.21.15.164:0/1949697827 shutdown_connections 2024-08-31T12:14:15.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c401c070 con 0x7f52cc0732e0 2024-08-31T12:14:15.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52c4017640 con 0x7f52cc0732e0 2024-08-31T12:14:15.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4017a70 con 0x7f52cc0732e0 2024-08-31T12:14:15.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc0cc490 con 0x7f52cc0732e0 2024-08-31T12:14:15.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c0c7920 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f11c2000640 1 -- 172.21.15.164:0/1775415367 shutdown_connections 2024-08-31T12:14:15.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f11c2000640 1 -- 172.21.15.164:0/1775415367 wait complete. 2024-08-31T12:14:15.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f0696e00640 1 -- 172.21.15.164:0/1949697827 wait complete. 2024-08-31T12:14:15.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc142e10 con 0x7f52cc0732e0 2024-08-31T12:14:15.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.444+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc0c62f0 con 0x7f52cc0732e0 2024-08-31T12:14:15.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 Processor -- start 2024-08-31T12:14:15.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 -- start start 2024-08-31T12:14:15.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f11c2000640 1 Processor -- start 2024-08-31T12:14:15.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f11c2000640 1 -- start start 2024-08-31T12:14:15.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 0x7f06880498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0688182290 0x7f0688185860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 0x7f06880d3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f06880451b0 con 0x7f0688047590 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f06880defc0 con 0x7f0688182290 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f0696e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f06880d4fc0 con 0x7f0688006d20 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2d740046d0 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f2d79600640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 0x7f2d5c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.448+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2d741302b0 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f2d81800640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 0x7f2d5c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0696400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 0x7f06880d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0696400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 0x7f06880d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:54530/0 (socket says 172.21.15.164:54530) 2024-08-31T12:14:15.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0696400640 1 -- 172.21.15.164:0/471714593 learned_addr learned my addr 172.21.15.164:0/471714593 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695000640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0688182290 0x7f0688185860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 0x7f06880498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc073610 0x7f11bc152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2d740c7020 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11bc0b2fd0 0x7f11bc1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc15c480 con 0x7f11bc0c8b00 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc15c300 con 0x7f11bc0b2fd0 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11c2000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc15c600 con 0x7f11bc073610 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42046/0 (socket says 172.21.15.164:42046) 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 -- 172.21.15.164:0/2411218068 learned_addr learned my addr 172.21.15.164:0/2411218068 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5e3005e190 con 0x7f5e3815a370 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11baa00640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11bc0b2fd0 0x7f11bc1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bb400640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc073610 0x7f11bc152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 -- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 msgr2=0x7f06880d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 0x7f06880d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 -- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0688182290 msgr2=0x7f0688185860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0688182290 0x7f0688185860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 -- 172.21.15.164:0/471714593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0688185da0 con 0x7f0688047590 2024-08-31T12:14:15.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f0695a00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 0x7f06880498e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f069006bc30 tx=0x7f0690074990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.456+0000 7f2d81800640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 0x7f2d5c074600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d680096c0 tx=0x7f2d68009260 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.456+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f52c401f070 con 0x7f52cc0732e0 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 -- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc073610 msgr2=0x7f11bc152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc073610 0x7f11bc152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 -- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11bc0b2fd0 msgr2=0x7f11bc1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11bc0b2fd0 0x7f11bc1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 -- 172.21.15.164:0/2411218068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc1f4330 con 0x7f11bc0c8b00 2024-08-31T12:14:15.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.452+0000 7f11bbe00640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0194b0 tx=0x7f11ac0a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.460+0000 7f52c9600640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 0x7f52ac0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.460+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52c4093ce0 con 0x7f52cc0732e0 2024-08-31T12:14:15.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.460+0000 7f52d0c00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 0x7f52ac0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.460+0000 7f52d0c00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 0x7f52ac0746d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52c001c650 tx=0x7f52c001b060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f52c405ec80 con 0x7f52cc0732e0 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900735a0 con 0x7f0688047590 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0690073740 con 0x7f0688047590 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690073af0 con 0x7f0688047590 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068804a050 con 0x7f0688047590 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.468+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068804a610 con 0x7f0688047590 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0ba020 con 0x7f11bc0c8b00 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11ac0044b0 con 0x7f11bc0c8b00 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc152980 con 0x7f11bc0c8b00 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc0cbd70 con 0x7f11bc0c8b00 2024-08-31T12:14:15.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0b2040 con 0x7f11bc0c8b00 2024-08-31T12:14:15.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.464+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc0c22b0 con 0x7f11bc0c8b00 2024-08-31T12:14:15.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.468+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0690073c90 con 0x7f0688047590 2024-08-31T12:14:15.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.472+0000 7f068d600640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 0x7f0670074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.472+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f11ac005260 con 0x7f11bc0c8b00 2024-08-31T12:14:15.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f11b3400640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 0x7f119c07ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06880de220 con 0x7f0688047590 2024-08-31T12:14:15.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f0695000640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 0x7f0670074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f11ac12daa0 con 0x7f11bc0c8b00 2024-08-31T12:14:15.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f11bb400640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 0x7f119c07ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f0695000640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 0x7f0670074620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f068804e9b0 tx=0x7f067c006840 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.476+0000 7f11bb400640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 0x7f119c07ceb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11b4004a40 tx=0x7f11b400d040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.480+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f11ac0c4020 con 0x7f11bc0c8b00 2024-08-31T12:14:15.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.480+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f06900d9f20 con 0x7f0688047590 2024-08-31T12:14:15.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.492+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f06900ddc90 con 0x7f0688047590 2024-08-31T12:14:15.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 -- 172.21.15.164:0/2756005681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0640e2710 msgr2=0x7fb0640e2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 --2- 172.21.15.164:0/2756005681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0640e2710 0x7fb0640e2b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb06c02e9d0 tx=0x7fb06c099f30 comp rx=0 tx=0).stop 2024-08-31T12:14:15.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 -- 172.21.15.164:0/2756005681 shutdown_connections 2024-08-31T12:14:15.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 --2- 172.21.15.164:0/2756005681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0640e2710 0x7fb0640e2b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 --2- 172.21.15.164:0/2756005681 >> v2:172.21.15.184:3300/0 conn(0x7fb0640d8cf0 0x7fb0640e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 -- 172.21.15.164:0/2756005681 >> 172.21.15.164:0/2756005681 conn(0x7fb06404fe40 msgr2=0x7fb064050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 -- 172.21.15.164:0/2756005681 shutdown_connections 2024-08-31T12:14:15.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.496+0000 7fb071200640 1 -- 172.21.15.164:0/2756005681 wait complete. 2024-08-31T12:14:15.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.500+0000 7fb071200640 1 Processor -- start 2024-08-31T12:14:15.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.500+0000 7fb071200640 1 -- start start 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb064044cc0 0x7fb0640dd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0640e2710 0x7fb0640cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb064007350 con 0x7fb064044cc0 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb064006ec0 con 0x7fb0640d8cf0 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb0640de130 con 0x7fb0640e2710 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:55910/0 (socket says 172.21.15.164:55910) 2024-08-31T12:14:15.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 -- 172.21.15.164:0/1636405502 learned_addr learned my addr 172.21.15.164:0/1636405502 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:15.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06be00640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0640e2710 0x7fb0640cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 -- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0640e2710 msgr2=0x7fb0640cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0640e2710 0x7fb0640cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 -- 172.21.15.164:0/1636405502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb064044cc0 msgr2=0x7fb0640dd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb064044cc0 0x7fb0640dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 -- 172.21.15.164:0/1636405502 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640cd190 con 0x7fb0640d8cf0 2024-08-31T12:14:15.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb06aa00640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb06000d950 tx=0x7fb06000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060017070 con 0x7fb0640d8cf0 2024-08-31T12:14:15.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0640ddc60 con 0x7fb0640d8cf0 2024-08-31T12:14:15.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.504+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0640dcbf0 con 0x7fb0640d8cf0 2024-08-31T12:14:15.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.508+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb060009d20 con 0x7fb0640d8cf0 2024-08-31T12:14:15.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.508+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060010660 con 0x7fb0640d8cf0 2024-08-31T12:14:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.512+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0480052a0 con 0x7fb0640d8cf0 2024-08-31T12:14:15.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.512+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb06001a070 con 0x7fb0640d8cf0 2024-08-31T12:14:15.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.512+0000 7fb05f400640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 0x7fb04c074800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.516+0000 7fb06b400640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 0x7fb04c074800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.516+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb060010460 con 0x7fb0640d8cf0 2024-08-31T12:14:15.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.520+0000 7fb06b400640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 0x7fb04c074800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb058001590 tx=0x7fb058007a00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:15.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.528+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb06005db00 con 0x7fb0640d8cf0 2024-08-31T12:14:15.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.796+0000 7f74cd000640 1 -- 172.21.15.164:0/1958194804 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f74c0179ea0 con 0x7f74c00483b0 2024-08-31T12:14:15.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.796+0000 7f74bb400640 1 -- 172.21.15.164:0/1958194804 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74c80dee60 con 0x7f74c00483b0 2024-08-31T12:14:15.800 INFO:teuthology.orchestra.run.smithi164.stdout:64424509450 2024-08-31T12:14:15.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 msgr2=0x7f74a80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 0x7f74a80745d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ddbd0 tx=0x7f74b4009060 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 msgr2=0x7f74c0044e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74c8066930 tx=0x7f74c80769a0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 shutdown_connections 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f74a80720c0 0x7f74a80745d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74c00e3010 0x7f74c00d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74c00e2300 0x7f74c00e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 --2- 172.21.15.164:0/1958194804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c00483b0 0x7f74c0044e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 >> 172.21.15.164:0/1958194804 conn(0x7f74c0050fb0 msgr2=0x7f74c00dde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 shutdown_connections 2024-08-31T12:14:15.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.800+0000 7f74b8c00640 1 -- 172.21.15.164:0/1958194804 wait complete. 2024-08-31T12:14:15.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.804+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5e3815c910 con 0x7f5e3815a370 2024-08-31T12:14:15.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.804+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2d7c0008e0 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.811 INFO:teuthology.orchestra.run.smithi164.stdout:55834574859 2024-08-31T12:14:15.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.804+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f43f0005860 con 0x7f43fc005160 2024-08-31T12:14:15.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.804+0000 7f440ea00640 1 -- 172.21.15.164:0/1732549172 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f440805d640 con 0x7f43fc005160 2024-08-31T12:14:15.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f5e35600640 1 -- 172.21.15.164:0/3820983044 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e30062950 con 0x7f5e3815a370 2024-08-31T12:14:15.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f2d79600640 1 -- 172.21.15.164:0/208728811 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2d74018b30 con 0x7f2d7c0c8b00 2024-08-31T12:14:15.813 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:15.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 msgr2=0x7f43f80746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 0x7f43f80746d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441004fa20 tx=0x7f44040091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 msgr2=0x7f44100d77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.808+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f440800c500 tx=0x7f440800c9c0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.814 INFO:teuthology.orchestra.run.smithi164.stdout:64424509449 2024-08-31T12:14:15.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 shutdown_connections 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43f80721c0 0x7f43f80746d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44100d6710 0x7f44100d3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44100d6300 0x7f44100d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 --2- 172.21.15.164:0/1732549172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43fc005160 0x7f44100d77c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 >> 172.21.15.164:0/1732549172 conn(0x7f441004fe40 msgr2=0x7f441004f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 shutdown_connections 2024-08-31T12:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f441d800640 1 -- 172.21.15.164:0/1732549172 wait complete. 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 msgr2=0x7f5e180745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 0x7f5e180745d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c01b450 tx=0x7f5e2c01b5e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 msgr2=0x7f5e38163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 0x7f5e38163370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e380b4470 tx=0x7f5e3000ead0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 shutdown_connections 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5e180720c0 0x7f5e180745d0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c01b450 tx=0x7f5e2c01b5e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e3815a370 0x7f5e38163370 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e38159f60 0x7f5e380c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 --2- 172.21.15.164:0/3820983044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e380c97e0 0x7f5e381f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 >> 172.21.15.164:0/3820983044 conn(0x7f5e38071be0 msgr2=0x7f5e38153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 shutdown_connections 2024-08-31T12:14:15.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f5e40000640 1 -- 172.21.15.164:0/3820983044 wait complete. 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 msgr2=0x7f2d5c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 0x7f2d5c074600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d680096c0 tx=0x7f2d68009260 comp rx=0 tx=0).stop 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 msgr2=0x7f2d7c153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.812+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009790 tx=0x7f2d74004620 comp rx=0 tx=0).stop 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 shutdown_connections 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2d5c0720f0 0x7f2d5c074600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d7c0c8b00 0x7f2d7c153d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d7c0c1f40 0x7f2d7c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 --2- 172.21.15.164:0/208728811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7c0b2f00 0x7f2d7c0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 >> 172.21.15.164:0/208728811 conn(0x7f2d7c0ccf20 msgr2=0x7f2d7c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 shutdown_connections 2024-08-31T12:14:15.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.816+0000 7f2d84200640 1 -- 172.21.15.164:0/208728811 wait complete. 2024-08-31T12:14:15.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.836+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f52cc050da0 con 0x7f52cc0732e0 2024-08-31T12:14:15.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-08-31T12:14:15.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.836+0000 7f52c9600640 1 -- 172.21.15.164:0/30776389 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52c4063440 con 0x7f52cc0732e0 2024-08-31T12:14:15.843 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:15.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f06880db990 con 0x7f0688047590 2024-08-31T12:14:15.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 msgr2=0x7f52ac0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 0x7f52ac0746d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52c001c650 tx=0x7f52c001b060 comp rx=0 tx=0).stop 2024-08-31T12:14:15.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 msgr2=0x7f52cc141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 0x7f52cc141280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52c400ee00 tx=0x7f52c400c6e0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f068d600640 1 -- 172.21.15.164:0/471714593 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06900e2450 con 0x7f0688047590 2024-08-31T12:14:15.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 shutdown_connections 2024-08-31T12:14:15.846 INFO:teuthology.orchestra.run.smithi164.stdout:64424509450 2024-08-31T12:14:15.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52ac0721c0 0x7f52ac0746d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52cc0c8580 0x7f52cc143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52cc0c7ca0 0x7f52cc0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 --2- 172.21.15.164:0/30776389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52cc0732e0 0x7f52cc141280 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 >> 172.21.15.164:0/30776389 conn(0x7f52cc0cca80 msgr2=0x7f52cc145790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 shutdown_connections 2024-08-31T12:14:15.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.840+0000 7f52d2a00640 1 -- 172.21.15.164:0/30776389 wait complete. 2024-08-31T12:14:15.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 msgr2=0x7f0670074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 0x7f0670074620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f068804e9b0 tx=0x7f067c006840 comp rx=0 tx=0).stop 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 msgr2=0x7f06880498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 0x7f06880498e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f069006bc30 tx=0x7f0690074990 comp rx=0 tx=0).stop 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 shutdown_connections 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0670072110 0x7f0670074620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0688006d20 0x7f06880d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0688182290 0x7f0688185860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 --2- 172.21.15.164:0/471714593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0688047590 0x7f06880498e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 >> 172.21.15.164:0/471714593 conn(0x7f0688050290 msgr2=0x7f068804f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 shutdown_connections 2024-08-31T12:14:15.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.844+0000 7f0696e00640 1 -- 172.21.15.164:0/471714593 wait complete. 2024-08-31T12:14:15.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.848+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f11bc0ca8d0 con 0x7f11bc0c8b00 2024-08-31T12:14:15.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.848+0000 7f11b3400640 1 -- 172.21.15.164:0/2411218068 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11ac016490 con 0x7f11bc0c8b00 2024-08-31T12:14:15.853 INFO:teuthology.orchestra.run.smithi164.stdout:64424509449 2024-08-31T12:14:15.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 msgr2=0x7f119c07ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 0x7f119c07ceb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11b4004a40 tx=0x7f11b400d040 comp rx=0 tx=0).stop 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 msgr2=0x7f11bc15b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0194b0 tx=0x7f11ac0a5790 comp rx=0 tx=0).stop 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 shutdown_connections 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f119c07a9a0 0x7f119c07ceb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc0c8b00 0x7f11bc15b0f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11bc0b2fd0 0x7f11bc1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 --2- 172.21.15.164:0/2411218068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11bc073610 0x7f11bc152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 >> 172.21.15.164:0/2411218068 conn(0x7f11bc0ccf20 msgr2=0x7f11bc1501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 shutdown_connections 2024-08-31T12:14:15.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.852+0000 7f11c2000640 1 -- 172.21.15.164:0/2411218068 wait complete. 2024-08-31T12:14:15.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2024-08-31T12:14:15.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-08-31T12:14:15.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-08-31T12:14:15.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.868+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb048005860 con 0x7fb0640d8cf0 2024-08-31T12:14:15.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.868+0000 7fb05f400640 1 -- 172.21.15.164:0/1636405502 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0600622c0 con 0x7fb0640d8cf0 2024-08-31T12:14:15.874 INFO:teuthology.orchestra.run.smithi164.stdout:64424509450 2024-08-31T12:14:15.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.6 2024-08-31T12:14:15.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 msgr2=0x7fb04c074800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 0x7fb04c074800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb058001590 tx=0x7fb058007a00 comp rx=0 tx=0).stop 2024-08-31T12:14:15.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 msgr2=0x7fb0640ded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:15.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb06000d950 tx=0x7fb06000de10 comp rx=0 tx=0).stop 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 shutdown_connections 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb04c0722f0 0x7fb04c074800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0640e2710 0x7fb0640cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0640d8cf0 0x7fb0640ded30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 --2- 172.21.15.164:0/1636405502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb064044cc0 0x7fb0640dd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 >> 172.21.15.164:0/1636405502 conn(0x7fb06404fe40 msgr2=0x7fb0640356a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 shutdown_connections 2024-08-31T12:14:15.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:15.872+0000 7fb071200640 1 -- 172.21.15.164:0/1636405502 wait complete. 2024-08-31T12:14:15.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.2 2024-08-31T12:14:15.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-08-31T12:14:15.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-08-31T12:14:16.843 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-31T12:14:16.861 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-31T12:14:16.861 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-31T12:14:16.864 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-31T12:14:16.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-31T12:14:16.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-31T12:14:16.885 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-31T12:14:16.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-31T12:14:17.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 -- 172.21.15.164:0/3878200429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e41513b0 msgr2=0x7f35e41517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 --2- 172.21.15.164:0/3878200429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e41513b0 0x7f35e41517c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35e40c6910 tx=0x7f35d001f0f0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 -- 172.21.15.164:0/3878200429 shutdown_connections 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 --2- 172.21.15.164:0/3878200429 >> v2:172.21.15.164:3300/0 conn(0x7f35e40c7400 0x7f35e40c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 --2- 172.21.15.164:0/3878200429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e41513b0 0x7f35e41517c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 -- 172.21.15.164:0/3878200429 >> 172.21.15.164:0/3878200429 conn(0x7f35e40cca80 msgr2=0x7f35e40cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 -- 172.21.15.164:0/3878200429 shutdown_connections 2024-08-31T12:14:17.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.088+0000 7f35e3200640 1 -- 172.21.15.164:0/3878200429 wait complete. 2024-08-31T12:14:17.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.092+0000 7f35e3200640 1 Processor -- start 2024-08-31T12:14:17.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.092+0000 7f35e3200640 1 -- start start 2024-08-31T12:14:17.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e41513b0 0x7f35e40744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e415b630 0x7f35e41f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40c6140 con 0x7f35e415b630 2024-08-31T12:14:17.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:45954/0 (socket says 172.21.15.164:45954) 2024-08-31T12:14:17.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 -- 172.21.15.164:0/3059402103 learned_addr learned my addr 172.21.15.164:0/3059402103 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e2800640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e415b630 0x7f35e41f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40c5e60 con 0x7f35e41513b0 2024-08-31T12:14:17.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f35e40c6420 con 0x7f35e40c7400 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1400640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e41513b0 0x7f35e40744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 -- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e41513b0 msgr2=0x7f35e40744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e41513b0 0x7f35e40744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 -- 172.21.15.164:0/3059402103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e415b630 msgr2=0x7f35e41f9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e415b630 0x7f35e41f9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.096+0000 7f35e1e00640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e414a040 con 0x7f35e40c7400 2024-08-31T12:14:17.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35e1e00640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c3f0 tx=0x7f35d400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4017070 con 0x7f35e40c7400 2024-08-31T12:14:17.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d40053c0 con 0x7f35e40c7400 2024-08-31T12:14:17.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e414ccd0 con 0x7f35e40c7400 2024-08-31T12:14:17.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4003860 con 0x7f35e40c7400 2024-08-31T12:14:17.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.100+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e4147d60 con 0x7f35e40c7400 2024-08-31T12:14:17.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.104+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e40c3e80 con 0x7f35e40c7400 2024-08-31T12:14:17.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.108+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f35d401a070 con 0x7f35e40c7400 2024-08-31T12:14:17.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.108+0000 7f35da000640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 0x7f35c40746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.108+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f35d4092200 con 0x7f35e40c7400 2024-08-31T12:14:17.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.112+0000 7f35e1400640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 0x7f35c40746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.112+0000 7f35e1400640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 0x7f35c40746a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35e415a8e0 tx=0x7f35dc009500 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f35d405d110 con 0x7f35e40c7400 2024-08-31T12:14:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 -- 172.21.15.164:0/3517019583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 msgr2=0x7fd198152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 --2- 172.21.15.164:0/3517019583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198152160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd188009900 tx=0x7fd18801c640 comp rx=0 tx=0).stop 2024-08-31T12:14:17.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 -- 172.21.15.164:0/3517019583 shutdown_connections 2024-08-31T12:14:17.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 --2- 172.21.15.164:0/3517019583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 --2- 172.21.15.164:0/3517019583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198152160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 -- 172.21.15.164:0/3517019583 >> 172.21.15.164:0/3517019583 conn(0x7fd198070da0 msgr2=0x7fd1980cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 -- 172.21.15.164:0/3517019583 shutdown_connections 2024-08-31T12:14:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.124+0000 7fd19da00640 1 -- 172.21.15.164:0/3517019583 wait complete. 2024-08-31T12:14:17.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.128+0000 7fd19da00640 1 Processor -- start 2024-08-31T12:14:17.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.128+0000 7fd19da00640 1 -- start start 2024-08-31T12:14:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd1980727d0 con 0x7fd1980c85f0 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd19815c310 con 0x7fd19806cc30 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19da00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd1980c2ee0 con 0x7fd198071e80 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:55926/0 (socket says 172.21.15.164:55926) 2024-08-31T12:14:17.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198141700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:45972/0 (socket says 172.21.15.164:45972) 2024-08-31T12:14:17.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 -- 172.21.15.164:0/2435490910 learned_addr learned my addr 172.21.15.164:0/2435490910 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd19d000640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 -- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 msgr2=0x7fd198141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 -- 172.21.15.164:0/2435490910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 msgr2=0x7fd198158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 -- 172.21.15.164:0/2435490910 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1980ccb10 con 0x7fd19806cc30 2024-08-31T12:14:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd197e00640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd188009850 tx=0x7fd1880a6540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1880ac050 con 0x7fd19806cc30 2024-08-31T12:14:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1880b5030 con 0x7fd19806cc30 2024-08-31T12:14:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.132+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188003860 con 0x7fd19806cc30 2024-08-31T12:14:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.136+0000 7fd19da00640 1 -- 172.21.15.164:0/2435490910 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1981f57d0 con 0x7fd19806cc30 2024-08-31T12:14:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.136+0000 7fd19da00640 1 -- 172.21.15.164:0/2435490910 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1981422b0 con 0x7fd19806cc30 2024-08-31T12:14:17.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.136+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1981508b0 con 0x7fd19806cc30 2024-08-31T12:14:17.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.140+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd1880af070 con 0x7fd19806cc30 2024-08-31T12:14:17.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.140+0000 7fd18fe00640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 0x7fd178074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.140+0000 7fd197400640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 0x7fd178074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.140+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd1880f4710 con 0x7fd19806cc30 2024-08-31T12:14:17.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.144+0000 7fd197400640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 0x7fd178074600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd19814c740 tx=0x7fd18400b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.152+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd19815b7f0 con 0x7fd19806cc30 2024-08-31T12:14:17.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 -- 172.21.15.164:0/3596830210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c2ee0 msgr2=0x7f0668155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 --2- 172.21.15.164:0/3596830210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c2ee0 0x7f0668155bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0658009840 tx=0x7f065801c840 comp rx=0 tx=0).stop 2024-08-31T12:14:17.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 -- 172.21.15.164:0/3596830210 shutdown_connections 2024-08-31T12:14:17.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 --2- 172.21.15.164:0/3596830210 >> v2:172.21.15.164:3300/0 conn(0x7f06680c88c0 0x7f066815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 --2- 172.21.15.164:0/3596830210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c2ee0 0x7f0668155bc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.156+0000 7f066e600640 1 -- 172.21.15.164:0/3596830210 >> 172.21.15.164:0/3596830210 conn(0x7f06680ca9c0 msgr2=0x7f06680cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.160+0000 7f066e600640 1 -- 172.21.15.164:0/3596830210 shutdown_connections 2024-08-31T12:14:17.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.160+0000 7f066e600640 1 -- 172.21.15.164:0/3596830210 wait complete. 2024-08-31T12:14:17.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.164+0000 7f066e600640 1 Processor -- start 2024-08-31T12:14:17.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.164+0000 7f066e600640 1 -- start start 2024-08-31T12:14:17.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 0x7f06681f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 0x7f0668142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0668168c80 con 0x7f06680c2ee0 2024-08-31T12:14:17.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0668168e00 con 0x7f0668071540 2024-08-31T12:14:17.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f066e600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0668168f80 con 0x7f06680c88c0 2024-08-31T12:14:17.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:55952/0 (socket says 172.21.15.164:55952) 2024-08-31T12:14:17.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 0x7f0668142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 0x7f0668142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:45992/0 (socket says 172.21.15.164:45992) 2024-08-31T12:14:17.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667e00640 1 -- 172.21.15.164:0/1327561225 learned_addr learned my addr 172.21.15.164:0/1327561225 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0666a00640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 0x7f06681f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 -- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 msgr2=0x7f0668142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 0x7f0668142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 -- 172.21.15.164:0/1327561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 msgr2=0x7f06681f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 0x7f06681f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0667400640 1 -- 172.21.15.164:0/1327561225 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680cc6e0 con 0x7f0668071540 2024-08-31T12:14:17.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.168+0000 7f0666a00640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 0x7f06681f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:14:17.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f0667400640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06580ac000 tx=0x7f06580a67b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658004480 con 0x7f0668071540 2024-08-31T12:14:17.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06580036f0 con 0x7f0668071540 2024-08-31T12:14:17.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658003b20 con 0x7f0668071540 2024-08-31T12:14:17.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066815dda0 con 0x7f0668071540 2024-08-31T12:14:17.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681f5e80 con 0x7f0668071540 2024-08-31T12:14:17.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.172+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06680cc8b0 con 0x7f0668071540 2024-08-31T12:14:17.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 -- 172.21.15.164:0/1400046145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52200c59e0 msgr2=0x7f52200cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 --2- 172.21.15.164:0/1400046145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52200c59e0 0x7f52200cf150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f52200b27d0 tx=0x7f521801cd80 comp rx=0 tx=0).stop 2024-08-31T12:14:17.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 -- 172.21.15.164:0/1400046145 shutdown_connections 2024-08-31T12:14:17.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 --2- 172.21.15.164:0/1400046145 >> v2:172.21.15.184:3300/0 conn(0x7f52201533d0 0x7f522015cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 -- 172.21.15.164:0/1941774067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c158470 msgr2=0x7f748c0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 --2- 172.21.15.164:0/1941774067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c158470 0x7f748c0c7920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f748400b6c0 tx=0x7f748401d440 comp rx=0 tx=0).stop 2024-08-31T12:14:17.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 --2- 172.21.15.164:0/1400046145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52200c59e0 0x7f52200cf150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 -- 172.21.15.164:0/1400046145 >> 172.21.15.164:0/1400046145 conn(0x7f5220073380 msgr2=0x7f5220073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 -- 172.21.15.164:0/1400046145 shutdown_connections 2024-08-31T12:14:17.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f5226000640 1 -- 172.21.15.164:0/1400046145 wait complete. 2024-08-31T12:14:17.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 -- 172.21.15.164:0/1941774067 shutdown_connections 2024-08-31T12:14:17.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 --2- 172.21.15.164:0/1941774067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c158470 0x7f748c0c7920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 --2- 172.21.15.164:0/1941774067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0c8b00 0x7f748c0c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 -- 172.21.15.164:0/1941774067 >> 172.21.15.164:0/1941774067 conn(0x7f748c0ccf20 msgr2=0x7f748c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0658003cc0 con 0x7f0668071540 2024-08-31T12:14:17.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 -- 172.21.15.164:0/1941774067 shutdown_connections 2024-08-31T12:14:17.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.176+0000 7f7491800640 1 -- 172.21.15.164:0/1941774067 wait complete. 2024-08-31T12:14:17.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f065f400640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 0x7f06480745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f065812d610 con 0x7f0668071540 2024-08-31T12:14:17.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f0666a00640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 0x7f06480745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f5226000640 1 Processor -- start 2024-08-31T12:14:17.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f5226000640 1 -- start start 2024-08-31T12:14:17.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f0666a00640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 0x7f06480745d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06680cd0b0 tx=0x7f0654007ea0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f7491800640 1 Processor -- start 2024-08-31T12:14:17.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.180+0000 7f7491800640 1 -- start start 2024-08-31T12:14:17.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52201533d0 0x7f5220158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f522015c140 0x7f5220145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f522015a3d0 con 0x7f522015c140 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f522015d070 con 0x7f52201533d0 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f52201fd0b0 con 0x7f52200c59e0 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:45998/0 (socket says 172.21.15.164:45998) 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 -- 172.21.15.164:0/130497612 learned_addr learned my addr 172.21.15.164:0/130497612 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f521fe00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52201533d0 0x7f5220158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5225600640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f522015c140 0x7f5220145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 -- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52201533d0 msgr2=0x7f5220158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52201533d0 0x7f5220158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 -- 172.21.15.164:0/130497612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f522015c140 msgr2=0x7f5220145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f522015c140 0x7f5220145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 -- 172.21.15.164:0/130497612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52201fcbe0 con 0x7f52200c59e0 2024-08-31T12:14:17.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5224c00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5218009bd0 tx=0x7f5218005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180b2040 con 0x7f52200c59e0 2024-08-31T12:14:17.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c0c8b00 0x7f748c0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c158470 0x7f748c0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1646d0 con 0x7f748c0c8b00 2024-08-31T12:14:17.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f748c164550 con 0x7f748c158470 2024-08-31T12:14:17.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f7491800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f748c164850 con 0x7f748c0b2fd0 2024-08-31T12:14:17.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:46004/0 (socket says 172.21.15.164:46004) 2024-08-31T12:14:17.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 -- 172.21.15.164:0/30675501 learned_addr learned my addr 172.21.15.164:0/30675501 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748b400640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c158470 0x7f748c0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748a000640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c0c8b00 0x7f748c0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 -- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c158470 msgr2=0x7f748c0c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c158470 0x7f748c0c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 -- 172.21.15.164:0/30675501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c0c8b00 msgr2=0x7f748c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f748aa00640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c0c8b00 0x7f748c0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f748aa00640 1 -- 172.21.15.164:0/30675501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c0c5a30 con 0x7f748c0b2fd0 2024-08-31T12:14:17.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5218003b30 con 0x7f52200c59e0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218005230 con 0x7f52200c59e0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5220150550 con 0x7f52200c59e0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.184+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5220154e40 con 0x7f52200c59e0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f748aa00640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747c00d980 tx=0x7f747c00de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c017070 con 0x7f748c0b2fd0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f747c009d20 con 0x7f748c0b2fd0 2024-08-31T12:14:17.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0106c0 con 0x7f748c0b2fd0 2024-08-31T12:14:17.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52200caa00 con 0x7f52200c59e0 2024-08-31T12:14:17.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c0c4450 con 0x7f748c0b2fd0 2024-08-31T12:14:17.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c0c4a10 con 0x7f748c0b2fd0 2024-08-31T12:14:17.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c0c22b0 con 0x7f748c0b2fd0 2024-08-31T12:14:17.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.188+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f52180bd030 con 0x7f52200c59e0 2024-08-31T12:14:17.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0658016430 con 0x7f0668071540 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23be000640 1 -- 172.21.15.164:0/642476852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00b0890 con 0x7f23c00c7400 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 -- 172.21.15.164:0/642476852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c00c7400 msgr2=0x7f23c00c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 --2- 172.21.15.164:0/642476852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c00c7400 0x7f23c00c7810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23c0159220 tx=0x7f23b001eff0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 -- 172.21.15.164:0/642476852 shutdown_connections 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 --2- 172.21.15.164:0/642476852 >> v2:172.21.15.164:3300/0 conn(0x7f23c01513b0 0x7f23c01517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 --2- 172.21.15.164:0/642476852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c00c7400 0x7f23c00c7810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 -- 172.21.15.164:0/642476852 >> 172.21.15.164:0/642476852 conn(0x7f23c00cca80 msgr2=0x7f23c00cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 -- 172.21.15.164:0/2821829207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd40004810 msgr2=0x7fdd40004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 --2- 172.21.15.164:0/2821829207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd40004810 0x7fdd40004c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdd48006ee0 tx=0x7fdd4801cdc0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 -- 172.21.15.164:0/642476852 shutdown_connections 2024-08-31T12:14:17.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f521cc00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 0x7f5200074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f23c5200640 1 -- 172.21.15.164:0/642476852 wait complete. 2024-08-31T12:14:17.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5218002020 con 0x7f52200c59e0 2024-08-31T12:14:17.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f521fe00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 0x7f5200074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7f521fe00640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 0x7f5200074600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5220073c90 tx=0x7f520c005f90 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 -- 172.21.15.164:0/2821829207 shutdown_connections 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 --2- 172.21.15.164:0/2821829207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd40004810 0x7fdd40004c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 -- 172.21.15.164:0/2821829207 >> 172.21.15.164:0/2821829207 conn(0x7fdd5c0cd1e0 msgr2=0x7fdd5c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 -- 172.21.15.164:0/2821829207 shutdown_connections 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.192+0000 7fdd61c00640 1 -- 172.21.15.164:0/2821829207 wait complete. 2024-08-31T12:14:17.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7f23c5200640 1 Processor -- start 2024-08-31T12:14:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 Processor -- start 2024-08-31T12:14:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 -- start start 2024-08-31T12:14:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7f23c5200640 1 -- start start 2024-08-31T12:14:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 0x7fdd5c0ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd5c0ae470 0x7fdd5c0abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0b3040 con 0x7fdd5c0ae060 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c165f60 con 0x7fdd5c0ae470 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd61c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5c0b31c0 con 0x7fdd40004810 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd5a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 0x7fdd5c0ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd5aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd5aa00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:46006/0 (socket says 172.21.15.164:46006) 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd5aa00640 1 -- 172.21.15.164:0/1719082736 learned_addr learned my addr 172.21.15.164:0/1719082736 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.196+0000 7fdd5b400640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd5c0ae470 0x7fdd5c0abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 -- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd5c0ae470 msgr2=0x7fdd5c0abac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd5c0ae470 0x7fdd5c0abac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 -- 172.21.15.164:0/1719082736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 msgr2=0x7fdd5c0ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 0x7fdd5c0ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 -- 172.21.15.164:0/1719082736 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c20a140 con 0x7fdd40004810 2024-08-31T12:14:17.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5a000640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 0x7fdd5c0ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:17.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd5aa00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e980 tx=0x7fdd4c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23c00c7400 0x7f23c00ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c01513b0 0x7f23c0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23c00c6140 con 0x7f23c01513b0 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f23c00c5e60 con 0x7f23c015b630 2024-08-31T12:14:17.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23c5200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f23c00c6420 con 0x7f23c00c7400 2024-08-31T12:14:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c01513b0 0x7f23c0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:56012/0 (socket says 172.21.15.164:56012) 2024-08-31T12:14:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 -- 172.21.15.164:0/959178159 learned_addr learned my addr 172.21.15.164:0/959178159 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f52180c4060 con 0x7f52200c59e0 2024-08-31T12:14:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 -- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23c00c7400 msgr2=0x7f23c00ca8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T12:14:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23c00c7400 0x7f23c00ca8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 -- 172.21.15.164:0/959178159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c01513b0 msgr2=0x7f23c0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c01513b0 0x7f23c0141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 -- 172.21.15.164:0/959178159 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0152020 con 0x7f23c015b630 2024-08-31T12:14:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7f23bfe00640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23b800b9e0 tx=0x7f23b800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.200+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00cd20 con 0x7fdd40004810 2024-08-31T12:14:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c0c9500 con 0x7fdd40004810 2024-08-31T12:14:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c0ad320 con 0x7fdd40004810 2024-08-31T12:14:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd4c004020 con 0x7fdd40004810 2024-08-31T12:14:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c004450 con 0x7fdd40004810 2024-08-31T12:14:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8019070 con 0x7f23c015b630 2024-08-31T12:14:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b800cc10 con 0x7f23c015b630 2024-08-31T12:14:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8014440 con 0x7f23c015b630 2024-08-31T12:14:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c01421c0 con 0x7f23c015b630 2024-08-31T12:14:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c014bf40 con 0x7f23c015b630 2024-08-31T12:14:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.204+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c074760 con 0x7fdd40004810 2024-08-31T12:14:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.208+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f747c01a070 con 0x7f748c0b2fd0 2024-08-31T12:14:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.208+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f23b801c070 con 0x7f23c015b630 2024-08-31T12:14:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.208+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c00c3e80 con 0x7f23c015b630 2024-08-31T12:14:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f7482a00640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 0x7f746c0746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f747c093300 con 0x7f748c0b2fd0 2024-08-31T12:14:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f748a000640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 0x7f746c0746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f23b7400640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 0x7f23a00746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23b8092a20 con 0x7f23c015b630 2024-08-31T12:14:17.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f23bf400640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 0x7f23a00746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f748a000640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 0x7f746c0746a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7478000f70 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.212+0000 7f23bf400640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 0x7f23a00746a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23c006f2b0 tx=0x7f23ac0078b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.216+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f747c05e330 con 0x7f748c0b2fd0 2024-08-31T12:14:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.220+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdd4c003600 con 0x7fdd40004810 2024-08-31T12:14:17.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.220+0000 7fdd52a00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 0x7fdd3c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.220+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdd4c093cb0 con 0x7fdd40004810 2024-08-31T12:14:17.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.224+0000 7fdd5a000640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 0x7fdd3c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.224+0000 7fdd5a000640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 0x7fdd3c074600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd480ab000 tx=0x7fdd48019c00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.224+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f23b805da50 con 0x7f23c015b630 2024-08-31T12:14:17.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.232+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdd4c05f430 con 0x7fdd40004810 2024-08-31T12:14:17.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 -- 172.21.15.164:0/2916194436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c155b30 msgr2=0x7fcd4c074b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 --2- 172.21.15.164:0/2916194436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c155b30 0x7fcd4c074b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0b3430 tx=0x7fcd4401f5a0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 -- 172.21.15.164:0/2916194436 shutdown_connections 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 --2- 172.21.15.164:0/2916194436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c155b30 0x7fcd4c074b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 --2- 172.21.15.164:0/2916194436 >> v2:172.21.15.184:3300/0 conn(0x7fcd4c0c9070 0x7fcd4c074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 -- 172.21.15.164:0/2916194436 >> 172.21.15.164:0/2916194436 conn(0x7fcd4c0cd1e0 msgr2=0x7fcd4c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 -- 172.21.15.164:0/2916194436 shutdown_connections 2024-08-31T12:14:17.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.284+0000 7fcd51e00640 1 -- 172.21.15.164:0/2916194436 wait complete. 2024-08-31T12:14:17.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 Processor -- start 2024-08-31T12:14:17.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 -- start start 2024-08-31T12:14:17.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd4c0c6740 0x7fcd4c1e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd4c155b30 0x7fcd4c0c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0c3080 con 0x7fcd4c0c9070 2024-08-31T12:14:17.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0c2250 con 0x7fcd4c155b30 2024-08-31T12:14:17.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd51e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c0c6c70 con 0x7fcd4c0c6740 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd4a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd4a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60902/0 (socket says 172.21.15.164:60902) 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd4a000640 1 -- 172.21.15.164:0/1758077633 learned_addr learned my addr 172.21.15.164:0/1758077633 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.292+0000 7fcd4b400640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd4c155b30 0x7fcd4c0c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4aa00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd4c0c6740 0x7fcd4c1e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 -- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd4c0c6740 msgr2=0x7fcd4c1e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd4c0c6740 0x7fcd4c1e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 -- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd4c155b30 msgr2=0x7fcd4c0c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd4c155b30 0x7fcd4c0c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 -- 172.21.15.164:0/1758077633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1e1500 con 0x7fcd4c0c9070 2024-08-31T12:14:17.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd4a000640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00c970 tx=0x7fcd3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c004220 con 0x7fcd4c0c9070 2024-08-31T12:14:17.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd3c0079b0 con 0x7fcd4c0c9070 2024-08-31T12:14:17.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0044b0 con 0x7fcd4c0c9070 2024-08-31T12:14:17.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1f05c0 con 0x7fcd4c0c9070 2024-08-31T12:14:17.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1e1220 con 0x7fcd4c0c9070 2024-08-31T12:14:17.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.296+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c0ca3f0 con 0x7fcd4c0c9070 2024-08-31T12:14:17.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.300+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fcd3c003600 con 0x7fcd4c0c9070 2024-08-31T12:14:17.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.300+0000 7fcd43400640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 0x7fcd2c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.308+0000 7fcd4aa00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 0x7fcd2c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.308+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcd3c091540 con 0x7fcd4c0c9070 2024-08-31T12:14:17.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.308+0000 7fcd4aa00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 0x7fcd2c074600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd380098e0 tx=0x7fcd38009060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.312+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcd4c1e1500 con 0x7fcd4c0c9070 2024-08-31T12:14:17.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.476+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f35e40c9270 con 0x7f35e40c7400 2024-08-31T12:14:17.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.476+0000 7f35da000640 1 -- 172.21.15.164:0/3059402103 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35d40618d0 con 0x7f35e40c7400 2024-08-31T12:14:17.481 INFO:teuthology.orchestra.run.smithi164.stdout:64424509452 2024-08-31T12:14:17.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 msgr2=0x7f35c40746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 0x7f35c40746a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35e415a8e0 tx=0x7f35dc009500 comp rx=0 tx=0).stop 2024-08-31T12:14:17.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 msgr2=0x7f35e414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c3f0 tx=0x7f35d400c8b0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 shutdown_connections 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c4072190 0x7f35c40746a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e415b630 0x7f35e41f9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e41513b0 0x7f35e40744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 --2- 172.21.15.164:0/3059402103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e40c7400 0x7f35e414c790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.480+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 >> 172.21.15.164:0/3059402103 conn(0x7f35e40cca80 msgr2=0x7f35e414f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.484+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 shutdown_connections 2024-08-31T12:14:17.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.484+0000 7f35e3200640 1 -- 172.21.15.164:0/3059402103 wait complete. 2024-08-31T12:14:17.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.496+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd1981505d0 con 0x7fd19806cc30 2024-08-31T12:14:17.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.496+0000 7fd18fe00640 1 -- 172.21.15.164:0/2435490910 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1880f8120 con 0x7fd19806cc30 2024-08-31T12:14:17.501 INFO:teuthology.orchestra.run.smithi164.stdout:64424509453 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 msgr2=0x7fd178074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 0x7fd178074600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd19814c740 tx=0x7fd18400b2e0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 msgr2=0x7fd1980cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd188009850 tx=0x7fd1880a6540 comp rx=0 tx=0).stop 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 shutdown_connections 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1780720f0 0x7fd178074600 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd19814c740 tx=0x7fd18400b2e0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1980c85f0 0x7fd198158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd198071e80 0x7fd198141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 --2- 172.21.15.164:0/2435490910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19806cc30 0x7fd1980cc5d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.504+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 >> 172.21.15.164:0/2435490910 conn(0x7fd198070da0 msgr2=0x7fd19806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.508+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 shutdown_connections 2024-08-31T12:14:17.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.508+0000 7fd18d600640 1 -- 172.21.15.164:0/2435490910 wait complete. 2024-08-31T12:14:17.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.1 2024-08-31T12:14:17.521 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.6 2024-08-31T12:14:17.544 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.540+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5220150840 con 0x7f52200c59e0 2024-08-31T12:14:17.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.544+0000 7f521cc00640 1 -- 172.21.15.164:0/130497612 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5218016970 con 0x7f52200c59e0 2024-08-31T12:14:17.548 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 msgr2=0x7f5200074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 0x7f5200074600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5220073c90 tx=0x7f520c005f90 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 msgr2=0x7f52201fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5218009bd0 tx=0x7f5218005040 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 shutdown_connections 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f52000720f0 0x7f5200074600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f522015c140 0x7f5220145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52201533d0 0x7f5220158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 --2- 172.21.15.164:0/130497612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52200c59e0 0x7f52201fc6a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 >> 172.21.15.164:0/130497612 conn(0x7f5220073380 msgr2=0x7f52200cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 shutdown_connections 2024-08-31T12:14:17.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.548+0000 7f5226000640 1 -- 172.21.15.164:0/130497612 wait complete. 2024-08-31T12:14:17.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.556+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f23c00cbde0 con 0x7f23c015b630 2024-08-31T12:14:17.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.556+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0668155bc0 con 0x7f0668071540 2024-08-31T12:14:17.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.556+0000 7f23b7400640 1 -- 172.21.15.164:0/959178159 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23b8062210 con 0x7f23c015b630 2024-08-31T12:14:17.560 INFO:teuthology.orchestra.run.smithi164.stdout:64424509452 2024-08-31T12:14:17.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.556+0000 7f065f400640 1 -- 172.21.15.164:0/1327561225 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06580f8d00 con 0x7f0668071540 2024-08-31T12:14:17.561 INFO:teuthology.orchestra.run.smithi164.stdout:64424509453 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 msgr2=0x7f23a00746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 0x7f23a00746a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23c006f2b0 tx=0x7f23ac0078b0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 msgr2=0x7f23c0142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23b800b9e0 tx=0x7f23b800bea0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 shutdown_connections 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23a0072190 0x7f23a00746a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23c015b630 0x7f23c0142d70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c01513b0 0x7f23c0141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 --2- 172.21.15.164:0/959178159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23c00c7400 0x7f23c00ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 >> 172.21.15.164:0/959178159 conn(0x7f23c00cca80 msgr2=0x7f23c006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 shutdown_connections 2024-08-31T12:14:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f23c5200640 1 -- 172.21.15.164:0/959178159 wait complete. 2024-08-31T12:14:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 msgr2=0x7f06480745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 0x7f06480745d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06680cd0b0 tx=0x7f0654007ea0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 msgr2=0x7f066815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06580ac000 tx=0x7f06580a67b0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 shutdown_connections 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f06480720c0 0x7f06480745d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06680c88c0 0x7f0668142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06680c2ee0 0x7f06681f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 --2- 172.21.15.164:0/1327561225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0668071540 0x7f066815d860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 >> 172.21.15.164:0/1327561225 conn(0x7f06680ca9c0 msgr2=0x7f0668145de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 shutdown_connections 2024-08-31T12:14:17.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.560+0000 7f066e600640 1 -- 172.21.15.164:0/1327561225 wait complete. 2024-08-31T12:14:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.576+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f748c0748f0 con 0x7f748c0b2fd0 2024-08-31T12:14:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.580+0000 7f7482a00640 1 -- 172.21.15.164:0/30675501 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f747c062af0 con 0x7f748c0b2fd0 2024-08-31T12:14:17.583 INFO:teuthology.orchestra.run.smithi164.stdout:55834574860 2024-08-31T12:14:17.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.3 2024-08-31T12:14:17.586 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 msgr2=0x7f746c0746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 0x7f746c0746a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7478000f70 tx=0x7f7478009040 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 msgr2=0x7f748c14e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747c00d980 tx=0x7f747c00de40 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 shutdown_connections 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f746c072190 0x7f746c0746a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c158470 0x7f748c0c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f748c0c8b00 0x7f748c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 --2- 172.21.15.164:0/30675501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0b2fd0 0x7f748c14e370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 >> 172.21.15.164:0/30675501 conn(0x7f748c0ccf20 msgr2=0x7f748c14a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 shutdown_connections 2024-08-31T12:14:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.584+0000 7f7491800640 1 -- 172.21.15.164:0/30675501 wait complete. 2024-08-31T12:14:17.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.2 2024-08-31T12:14:17.590 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.588+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdd5c162020 con 0x7fdd40004810 2024-08-31T12:14:17.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.588+0000 7fdd52a00640 1 -- 172.21.15.164:0/1719082736 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd4c05ed30 con 0x7fdd40004810 2024-08-31T12:14:17.594 INFO:teuthology.orchestra.run.smithi164.stdout:64424509451 2024-08-31T12:14:17.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.0 2024-08-31T12:14:17.597 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 msgr2=0x7fdd3c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 0x7fdd3c074600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd480ab000 tx=0x7fdd48019c00 comp rx=0 tx=0).stop 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 msgr2=0x7fdd5c209c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e980 tx=0x7fdd4c00ee40 comp rx=0 tx=0).stop 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 shutdown_connections 2024-08-31T12:14:17.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdd3c0720f0 0x7fdd3c074600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd5c0ae470 0x7fdd5c0abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdd5c0ae060 0x7fdd5c0ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 --2- 172.21.15.164:0/1719082736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd40004810 0x7fdd5c209c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 >> 172.21.15.164:0/1719082736 conn(0x7fdd5c0cd1e0 msgr2=0x7fdd5c166110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 shutdown_connections 2024-08-31T12:14:17.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.592+0000 7fdd61c00640 1 -- 172.21.15.164:0/1719082736 wait complete. 2024-08-31T12:14:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.600+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcd4c0c7860 con 0x7fcd4c0c9070 2024-08-31T12:14:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.600+0000 7fcd43400640 1 -- 172.21.15.164:0/1758077633 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd3c014030 con 0x7fcd4c0c9070 2024-08-31T12:14:17.606 INFO:teuthology.orchestra.run.smithi164.stdout:64424509452 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 msgr2=0x7fcd2c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 0x7fcd2c074600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd380098e0 tx=0x7fcd38009060 comp rx=0 tx=0).stop 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 msgr2=0x7fcd4c1f0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00c970 tx=0x7fcd3c00ce30 comp rx=0 tx=0).stop 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 shutdown_connections 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fcd2c0720f0 0x7fcd2c074600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd4c155b30 0x7fcd4c0c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c0c9070 0x7fcd4c1f0080 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 --2- 172.21.15.164:0/1758077633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd4c0c6740 0x7fcd4c1e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 >> 172.21.15.164:0/1758077633 conn(0x7fcd4c0cd1e0 msgr2=0x7fcd4c158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 shutdown_connections 2024-08-31T12:14:17.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.604+0000 7fcd51e00640 1 -- 172.21.15.164:0/1758077633 wait complete. 2024-08-31T12:14:17.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2024-08-31T12:14:17.613 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.7 2024-08-31T12:14:17.622 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2024-08-31T12:14:17.632 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:17.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T12:14:17.633 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:17.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 -- 172.21.15.164:0/1666640536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb090004d50 msgr2=0x7fb090005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1666640536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb090004d50 0x7fb090005160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80735c0 tx=0x7fb0a401d2a0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0ae800640 1 -- 172.21.15.164:0/1666640536 reap_dead start 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 -- 172.21.15.164:0/1666640536 shutdown_connections 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 -- 172.21.15.164:0/1666640536 >> 172.21.15.164:0/1666640536 conn(0x7fb0a80ccf20 msgr2=0x7fb0a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 -- 172.21.15.164:0/1666640536 shutdown_connections 2024-08-31T12:14:17.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.828+0000 7fb0b0800640 1 -- 172.21.15.164:0/1666640536 wait complete. 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 Processor -- start 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- start start 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0a81e5930 0x7fb0a81ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 0x7fb0a8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8074fb0 con 0x7fb0a814d920 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a8074e30 con 0x7fb0a8155490 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a8152a10 con 0x7fb0a81e5930 2024-08-31T12:14:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60916/0 (socket says 172.21.15.164:60916) 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 -- 172.21.15.164:0/1929182532 learned_addr learned my addr 172.21.15.164:0/1929182532 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ad400640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 0x7fb0a8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ade00640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0a81e5930 0x7fb0a81ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 -- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0a81e5930 msgr2=0x7fb0a81ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0a81e5930 0x7fb0a81ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 -- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 msgr2=0x7fb0a8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 0x7fb0a8151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 -- 172.21.15.164:0/1929182532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a81e3880 con 0x7fb0a814d920 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ad400640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 0x7fb0a8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0ae800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0a401d780 tx=0x7fb0a4006530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40b2030 con 0x7fb0a814d920 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0a4006650 con 0x7fb0a814d920 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4004e60 con 0x7fb0a814d920 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a81e2e60 con 0x7fb0a814d920 2024-08-31T12:14:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.832+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a8153010 con 0x7fb0a814d920 2024-08-31T12:14:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.836+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a80c7d30 con 0x7fb0a814d920 2024-08-31T12:14:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.836+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb0a4003a60 con 0x7fb0a814d920 2024-08-31T12:14:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.836+0000 7fb0a2000640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 0x7fb08c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.836+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb0a412d670 con 0x7fb0a814d920 2024-08-31T12:14:17.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.836+0000 7fb0ade00640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 0x7fb08c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:17.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.840+0000 7fb0ade00640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 0x7fb08c0745d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009ab0 tx=0x7fb09c0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:17.840+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb0a4017050 con 0x7fb0a814d920 2024-08-31T12:14:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.004+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0a814e270 con 0x7fb08c0720c0 2024-08-31T12:14:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.024+0000 7fb0a2000640 1 -- 172.21.15.164:0/1929182532 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fb0a814e270 con 0x7fb08c0720c0 2024-08-31T12:14:18.030 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:18.032 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:18.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 msgr2=0x7fb08c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 0x7fb08c0745d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009ab0 tx=0x7fb09c0091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 msgr2=0x7fb0a814dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0a401d780 tx=0x7fb0a4006530 comp rx=0 tx=0).stop 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 shutdown_connections 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb08c0720c0 0x7fb08c0745d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0a814d920 0x7fb0a814dd30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0a8155490 0x7fb0a8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 --2- 172.21.15.164:0/1929182532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0a81e5930 0x7fb0a81ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 >> 172.21.15.164:0/1929182532 conn(0x7fb0a80ccf20 msgr2=0x7fb0a80715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 shutdown_connections 2024-08-31T12:14:18.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.028+0000 7fb0b0800640 1 -- 172.21.15.164:0/1929182532 wait complete. 2024-08-31T12:14:18.051 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-08-31T12:14:16.541605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005819"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:01.323202+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:01.323202+0000","last_peered":"2024-08-31T12:14:01.323202+0000","last_clean":"2024-08-31T12:14:01.323202+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:01.323202+0000","last_undegraded":"2024-08-31T12:14:01.323202+0000","last_fullsized":"2024-08-31T12:14:01.323202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:18.056 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:18.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- 172.21.15.164:0/483419975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 msgr2=0x7fe21c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 --2- 172.21.15.164:0/483419975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c152a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0c9020 tx=0x7fe20c01f0d0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- 172.21.15.164:0/483419975 shutdown_connections 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 --2- 172.21.15.164:0/483419975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c1f40 0x7fe21c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 --2- 172.21.15.164:0/483419975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c152a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- 172.21.15.164:0/483419975 >> 172.21.15.164:0/483419975 conn(0x7fe21c0ccf20 msgr2=0x7fe21c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- 172.21.15.164:0/483419975 shutdown_connections 2024-08-31T12:14:18.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- 172.21.15.164:0/483419975 wait complete. 2024-08-31T12:14:18.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 Processor -- start 2024-08-31T12:14:18.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.244+0000 7fe221600640 1 -- start start 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe21c0c1f40 0x7fe21c1f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 0x7fe21c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c074fb0 con 0x7fe21c15bc70 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c074e30 con 0x7fe21c0c1f40 2024-08-31T12:14:18.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0c7d30 con 0x7fe21c0c7920 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60948/0 (socket says 172.21.15.164:60948) 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 -- 172.21.15.164:0/879043848 learned_addr learned my addr 172.21.15.164:0/879043848 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21aa00640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe21c0c1f40 0x7fe21c1f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe212000640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 0x7fe21c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 -- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 msgr2=0x7fe21c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 0x7fe21c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 -- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe21c0c1f40 msgr2=0x7fe21c1f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe21c0c1f40 0x7fe21c1f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 -- 172.21.15.164:0/879043848 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c1f05b0 con 0x7fe21c15bc70 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe212000640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 0x7fe21c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe21b400640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c6e0 tx=0x7fe21400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:18.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214003b80 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe214003d20 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c159440 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214005330 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0cb810 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0ccd20 con 0x7fe21c15bc70 2024-08-31T12:14:18.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.248+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe2140054d0 con 0x7fe21c15bc70 2024-08-31T12:14:18.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.252+0000 7fe213400640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 0x7fe1f8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.252+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe214092bb0 con 0x7fe21c15bc70 2024-08-31T12:14:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.252+0000 7fe21aa00640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 0x7fe1f8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.252+0000 7fe21aa00640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 0x7fe1f8074600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0b2000 tx=0x7fe20c01d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:18.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.256+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe21405e230 con 0x7fe21c15bc70 2024-08-31T12:14:18.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.420+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe21c1560a0 con 0x7fe1f80720f0 2024-08-31T12:14:18.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.436+0000 7fe213400640 1 -- 172.21.15.164:0/879043848 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fe21c1560a0 con 0x7fe1f80720f0 2024-08-31T12:14:18.444 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:18.446 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:18.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 msgr2=0x7fe1f8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 0x7fe1f8074600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0b2000 tx=0x7fe20c01d910 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 msgr2=0x7fe21c14f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c6e0 tx=0x7fe21400cba0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 shutdown_connections 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1f80720f0 0x7fe1f8074600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe21c15bc70 0x7fe21c14f240 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe21c0c7920 0x7fe21c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 --2- 172.21.15.164:0/879043848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe21c0c1f40 0x7fe21c1f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 >> 172.21.15.164:0/879043848 conn(0x7fe21c0ccf20 msgr2=0x7fe21c0b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 shutdown_connections 2024-08-31T12:14:18.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.440+0000 7fe221600640 1 -- 172.21.15.164:0/879043848 wait complete. 2024-08-31T12:14:18.465 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-08-31T12:14:16.541605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005819"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:01.323202+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:01.323202+0000","last_peered":"2024-08-31T12:14:01.323202+0000","last_clean":"2024-08-31T12:14:01.323202+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:01.323202+0000","last_undegraded":"2024-08-31T12:14:01.323202+0000","last_fullsized":"2024-08-31T12:14:01.323202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:18.470 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T12:14:18.471 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T12:14:18.471 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-31T12:14:18.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 -- 172.21.15.164:0/3547674288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a00b1a50 msgr2=0x7f47a0150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 --2- 172.21.15.164:0/3547674288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a00b1a50 0x7f47a0150200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47a015cee0 tx=0x7f479001c870 comp rx=0 tx=0).stop 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 -- 172.21.15.164:0/3547674288 shutdown_connections 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 --2- 172.21.15.164:0/3547674288 >> v2:172.21.15.184:3300/0 conn(0x7f47a015d4d0 0x7f47a015d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 --2- 172.21.15.164:0/3547674288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a00b1a50 0x7f47a0150200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.652+0000 7f479f200640 1 -- 172.21.15.164:0/3547674288 >> 172.21.15.164:0/3547674288 conn(0x7f47a006cc30 msgr2=0x7f47a006d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 -- 172.21.15.164:0/3547674288 shutdown_connections 2024-08-31T12:14:18.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 -- 172.21.15.164:0/3547674288 wait complete. 2024-08-31T12:14:18.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 Processor -- start 2024-08-31T12:14:18.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 -- start start 2024-08-31T12:14:18.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00b1a50 0x7f47a0145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.656+0000 7f479f200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00cedf0 0x7f47a00ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cab80 con 0x7f47a015d4d0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cf610 con 0x7f47a00b1a50 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f47a0153d80 con 0x7f47a00cedf0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00b1a50 0x7f47a0145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60970/0 (socket says 172.21.15.164:60970) 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 -- 172.21.15.164:0/869416944 learned_addr learned my addr 172.21.15.164:0/869416944 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f4795400640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00cedf0 0x7f47a00ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 -- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00cedf0 msgr2=0x7f47a00ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00cedf0 0x7f47a00ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 -- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00b1a50 msgr2=0x7f47a0145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00b1a50 0x7f47a0145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 -- 172.21.15.164:0/869416944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a015cab0 con 0x7f47a015d4d0 2024-08-31T12:14:18.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479e800640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f479800c730 tx=0x7f479800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:18.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798003b80 con 0x7f47a015d4d0 2024-08-31T12:14:18.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4798003d20 con 0x7f47a015d4d0 2024-08-31T12:14:18.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798005330 con 0x7f47a015d4d0 2024-08-31T12:14:18.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a01647a0 con 0x7f47a015d4d0 2024-08-31T12:14:18.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a006ef00 con 0x7f47a015d4d0 2024-08-31T12:14:18.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a00cd550 con 0x7f47a015d4d0 2024-08-31T12:14:18.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.660+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f47980056e0 con 0x7f47a015d4d0 2024-08-31T12:14:18.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.664+0000 7f4796a00640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 0x7f477c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:18.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.664+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4798092d10 con 0x7f47a015d4d0 2024-08-31T12:14:18.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.664+0000 7f479de00640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 0x7f477c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:18.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.664+0000 7f479de00640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 0x7f477c074600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47900af000 tx=0x7f47900a7040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:18.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.668+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4798098020 con 0x7f47a015d4d0 2024-08-31T12:14:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.872+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47a00ca540 con 0x7f47a015d4d0 2024-08-31T12:14:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.872+0000 7f4796a00640 1 -- 172.21.15.164:0/869416944 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f479805dc30 con 0x7f47a015d4d0 2024-08-31T12:14:18.879 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:18.879 INFO:teuthology.orchestra.run.smithi164.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 msgr2=0x7f477c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 0x7f477c074600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47900af000 tx=0x7f47900a7040 comp rx=0 tx=0).stop 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 msgr2=0x7f47a00ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f479800c730 tx=0x7f479800cbf0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 shutdown_connections 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f477c0720f0 0x7f477c074600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47a015d4d0 0x7f47a00ce630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00cedf0 0x7f47a00ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 --2- 172.21.15.164:0/869416944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00b1a50 0x7f47a0145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:18.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 >> 172.21.15.164:0/869416944 conn(0x7f47a006cc30 msgr2=0x7f47a0072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:18.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 shutdown_connections 2024-08-31T12:14:18.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:18.876+0000 7f479f200640 1 -- 172.21.15.164:0/869416944 wait complete. 2024-08-31T12:14:18.901 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-31T12:14:18.901 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 -- 172.21.15.164:0/1786888435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad74071ea0 msgr2=0x7fad740c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 --2- 172.21.15.164:0/1786888435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad74071ea0 0x7fad740c9c70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad60009840 tx=0x7fad6001c820 comp rx=0 tx=0).stop 2024-08-31T12:14:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 -- 172.21.15.164:0/1786888435 shutdown_connections 2024-08-31T12:14:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 --2- 172.21.15.164:0/1786888435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad740ca1b0 0x7fad741588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 --2- 172.21.15.164:0/1786888435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad74071ea0 0x7fad740c9c70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 -- 172.21.15.164:0/1786888435 >> 172.21.15.164:0/1786888435 conn(0x7fad740ca9c0 msgr2=0x7fad740cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 -- 172.21.15.164:0/1786888435 shutdown_connections 2024-08-31T12:14:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.048+0000 7fad7a800640 1 -- 172.21.15.164:0/1786888435 wait complete. 2024-08-31T12:14:19.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 Processor -- start 2024-08-31T12:14:19.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 -- start start 2024-08-31T12:14:19.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad74071ea0 0x7fad741538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad740c2ee0 0x7fad7413f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fad74152db0 con 0x7fad740ca1b0 2024-08-31T12:14:19.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad740722b0 con 0x7fad740c2ee0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad7a800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fad74152f30 con 0x7fad74071ea0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60974/0 (socket says 172.21.15.164:60974) 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73e00640 1 -- 172.21.15.164:0/2407590649 learned_addr learned my addr 172.21.15.164:0/2407590649 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73400640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad74071ea0 0x7fad741538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad72a00640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad740c2ee0 0x7fad7413f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73e00640 1 -- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad74071ea0 msgr2=0x7fad741538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.052+0000 7fad73e00640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad74071ea0 0x7fad741538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad73e00640 1 -- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad740c2ee0 msgr2=0x7fad7413f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad73e00640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad740c2ee0 0x7fad7413f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad73e00640 1 -- 172.21.15.164:0/2407590649 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad74153e20 con 0x7fad740ca1b0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad73e00640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ea80 tx=0x7fad6c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00cea0 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad6c004b30 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741447f0 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c005020 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad74155e20 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad74155970 con 0x7fad740ca1b0 2024-08-31T12:14:19.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.056+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fad6c0051c0 con 0x7fad740ca1b0 2024-08-31T12:14:19.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.060+0000 7fad6b400640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 0x7fad54074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.060+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fad6c0939f0 con 0x7fad740ca1b0 2024-08-31T12:14:19.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.060+0000 7fad73400640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 0x7fad54074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.060+0000 7fad73400640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 0x7fad54074600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad64007fd0 tx=0x7fad64007ea0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.064+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fad6c05e9a0 con 0x7fad740ca1b0 2024-08-31T12:14:19.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.260+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad740c9c70 con 0x7fad740ca1b0 2024-08-31T12:14:19.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.260+0000 7fad6b400640 1 -- 172.21.15.164:0/2407590649 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7fad6c063160 con 0x7fad740ca1b0 2024-08-31T12:14:19.265 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:19.265 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:19.266 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:19.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 msgr2=0x7fad54074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 0x7fad54074600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad64007fd0 tx=0x7fad64007ea0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 msgr2=0x7fad74145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ea80 tx=0x7fad6c00ef40 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 shutdown_connections 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fad540720f0 0x7fad54074600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad740ca1b0 0x7fad74145570 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad740c2ee0 0x7fad7413f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 --2- 172.21.15.164:0/2407590649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad74071ea0 0x7fad741538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 >> 172.21.15.164:0/2407590649 conn(0x7fad740ca9c0 msgr2=0x7fad74156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 shutdown_connections 2024-08-31T12:14:19.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.264+0000 7fad7a800640 1 -- 172.21.15.164:0/2407590649 wait complete. 2024-08-31T12:14:19.287 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:19.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- 172.21.15.164:0/1220241006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 msgr2=0x7f4e700c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 --2- 172.21.15.164:0/1220241006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e700c8d70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009870 tx=0x7f4e5801efb0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- 172.21.15.164:0/1220241006 shutdown_connections 2024-08-31T12:14:19.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 --2- 172.21.15.164:0/1220241006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e700c8d70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 --2- 172.21.15.164:0/1220241006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 0x7f4e70156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- 172.21.15.164:0/1220241006 >> 172.21.15.164:0/1220241006 conn(0x7f4e700ccf20 msgr2=0x7f4e700cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:19.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- 172.21.15.164:0/1220241006 shutdown_connections 2024-08-31T12:14:19.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- 172.21.15.164:0/1220241006 wait complete. 2024-08-31T12:14:19.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 Processor -- start 2024-08-31T12:14:19.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.436+0000 7f4e75600640 1 -- start start 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 0x7f4e700c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 0x7f4e7014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70159c90 con 0x7f4e7015ce10 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701599b0 con 0x7f4e7015d220 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e70159f70 con 0x7f4e70074e20 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60982/0 (socket says 172.21.15.164:60982) 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 -- 172.21.15.164:0/2491385213 learned_addr learned my addr 172.21.15.164:0/2491385213 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e6ea00640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 0x7f4e700c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e6f400640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 0x7f4e7014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 -- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 msgr2=0x7f4e700c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 0x7f4e700c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 -- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 msgr2=0x7f4e7014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 0x7f4e7014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 -- 172.21.15.164:0/2491385213 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700c33b0 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e6f400640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 0x7f4e7014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e66000640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009790 tx=0x7f4e58005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580be070 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e580053e0 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580b5040 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e700cbd00 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e700cc6b0 con 0x7f4e7015ce10 2024-08-31T12:14:19.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.440+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70071e40 con 0x7f4e7015ce10 2024-08-31T12:14:19.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.444+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4e580046d0 con 0x7f4e7015ce10 2024-08-31T12:14:19.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.444+0000 7f4e67400640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 0x7f4e4c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.444+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4e5812fe00 con 0x7f4e7015ce10 2024-08-31T12:14:19.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.444+0000 7f4e6ea00640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 0x7f4e4c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.444+0000 7f4e6ea00640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 0x7f4e4c0745c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009b40 tx=0x7f4e600091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.448+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4e58018b70 con 0x7f4e7015ce10 2024-08-31T12:14:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.648+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e7014fa50 con 0x7f4e7015ce10 2024-08-31T12:14:19.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.648+0000 7f4e67400640 1 -- 172.21.15.164:0/2491385213 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f4e580fad20 con 0x7f4e7015ce10 2024-08-31T12:14:19.653 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:19.653 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:19.654 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 msgr2=0x7f4e4c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 0x7f4e4c0745c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009b40 tx=0x7f4e600091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 msgr2=0x7f4e7015b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009790 tx=0x7f4e58005db0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 shutdown_connections 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4e4c0720b0 0x7f4e4c0745c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e7015d220 0x7f4e7014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e7015ce10 0x7f4e7015b2c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 --2- 172.21.15.164:0/2491385213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e70074e20 0x7f4e700c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 >> 172.21.15.164:0/2491385213 conn(0x7f4e700ccf20 msgr2=0x7f4e70071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:19.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 shutdown_connections 2024-08-31T12:14:19.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.652+0000 7f4e75600640 1 -- 172.21.15.164:0/2491385213 wait complete. 2024-08-31T12:14:19.676 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- 172.21.15.164:0/1889710402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36c0004810 msgr2=0x7f36c0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 --2- 172.21.15.164:0/1889710402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36c0004810 0x7f36c0004c20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36c400c2e0 tx=0x7f36c401f6e0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- 172.21.15.164:0/1889710402 shutdown_connections 2024-08-31T12:14:19.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 --2- 172.21.15.164:0/1889710402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36c0004810 0x7f36c0004c20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- 172.21.15.164:0/1889710402 >> 172.21.15.164:0/1889710402 conn(0x7f36dc071be0 msgr2=0x7f36dc06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:19.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- 172.21.15.164:0/1889710402 shutdown_connections 2024-08-31T12:14:19.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- 172.21.15.164:0/1889710402 wait complete. 2024-08-31T12:14:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 Processor -- start 2024-08-31T12:14:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.828+0000 7f36e2200640 1 -- start start 2024-08-31T12:14:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c0004810 0x7f36dc14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36dc0c6990 0x7f36dc0c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc0cabf0 con 0x7f36dc0c77a0 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc159ad0 con 0x7f36c0004810 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc08cff0 con 0x7f36dc0c6990 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60990/0 (socket says 172.21.15.164:60990) 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 -- 172.21.15.164:0/1341927817 learned_addr learned my addr 172.21.15.164:0/1341927817 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36db400640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c0004810 0x7f36dc14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36dbe00640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36dc0c6990 0x7f36dc0c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 -- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36dc0c6990 msgr2=0x7f36dc0c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36dc0c6990 0x7f36dc0c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 -- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c0004810 msgr2=0x7f36dc14fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c0004810 0x7f36dc14fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 -- 172.21.15.164:0/1341927817 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc150020 con 0x7f36dc0c77a0 2024-08-31T12:14:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d2a00640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36c40263f0 tx=0x7f36c4004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40bd020 con 0x7f36dc0c77a0 2024-08-31T12:14:19.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36c40b4040 con 0x7f36dc0c77a0 2024-08-31T12:14:19.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40b3030 con 0x7f36dc0c77a0 2024-08-31T12:14:19.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc1e3f20 con 0x7f36dc0c77a0 2024-08-31T12:14:19.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc1f02c0 con 0x7f36dc0c77a0 2024-08-31T12:14:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc150740 con 0x7f36dc0c77a0 2024-08-31T12:14:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.832+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f36c40c0020 con 0x7f36dc0c77a0 2024-08-31T12:14:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.836+0000 7f36d3e00640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 0x7f36b8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.836+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f36c4130b90 con 0x7f36dc0c77a0 2024-08-31T12:14:19.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.836+0000 7f36db400640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 0x7f36b8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:19.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.836+0000 7f36db400640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 0x7f36b8074600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36cc011440 tx=0x7f36cc009500 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:19.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:19.840+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f36c40c7030 con 0x7f36dc0c77a0 2024-08-31T12:14:20.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.004+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36dc159780 con 0x7f36dc0c77a0 2024-08-31T12:14:20.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36d3e00640 1 -- 172.21.15.164:0/1341927817 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f36c4019490 con 0x7f36dc0c77a0 2024-08-31T12:14:20.011 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:20.011 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 msgr2=0x7f36b8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 0x7f36b8074600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36cc011440 tx=0x7f36cc009500 comp rx=0 tx=0).stop 2024-08-31T12:14:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 msgr2=0x7f36dc1e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36c40263f0 tx=0x7f36c4004be0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 shutdown_connections 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f36b80720f0 0x7f36b8074600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36dc0c6990 0x7f36dc0c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36dc0c77a0 0x7f36dc1e39e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 --2- 172.21.15.164:0/1341927817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c0004810 0x7f36dc14fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 >> 172.21.15.164:0/1341927817 conn(0x7f36dc071be0 msgr2=0x7f36dc0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 shutdown_connections 2024-08-31T12:14:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.008+0000 7f36e2200640 1 -- 172.21.15.164:0/1341927817 wait complete. 2024-08-31T12:14:20.034 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 -- 172.21.15.164:0/1538981902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0b2900 msgr2=0x7f456c0c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 --2- 172.21.15.164:0/1538981902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0b2900 0x7f456c0c1f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4554009840 tx=0x7f455401c4d0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 -- 172.21.15.164:0/1538981902 shutdown_connections 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 --2- 172.21.15.164:0/1538981902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0b2900 0x7f456c0c1f40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 --2- 172.21.15.164:0/1538981902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2fe0 0x7f456c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 -- 172.21.15.164:0/1538981902 >> 172.21.15.164:0/1538981902 conn(0x7f456c0ccf20 msgr2=0x7f456c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:20.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 -- 172.21.15.164:0/1538981902 shutdown_connections 2024-08-31T12:14:20.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.184+0000 7f4573400640 1 -- 172.21.15.164:0/1538981902 wait complete. 2024-08-31T12:14:20.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 Processor -- start 2024-08-31T12:14:20.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- start start 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2900 0x7f456c14bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0c2480 0x7f456c14d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f456c158a10 con 0x7f456c0b2fe0 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f456c0c9130 con 0x7f456c0c2480 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f456c162750 con 0x7f456c0b2900 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:20.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60992/0 (socket says 172.21.15.164:60992) 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 -- 172.21.15.164:0/342013239 learned_addr learned my addr 172.21.15.164:0/342013239 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4570a00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2900 0x7f456c14bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4571400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0c2480 0x7f456c14d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 -- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2900 msgr2=0x7f456c14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2900 0x7f456c14bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 -- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0c2480 msgr2=0x7f456c14d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0c2480 0x7f456c14d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 -- 172.21.15.164:0/342013239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c150b50 con 0x7f456c0b2fe0 2024-08-31T12:14:20.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4563e00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45540190e0 tx=0x7f45540056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540b1040 con 0x7f456c0b2fe0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45540bc070 con 0x7f456c0b2fe0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c164400 con 0x7f456c0b2fe0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540acd00 con 0x7f456c0b2fe0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.188+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c151760 con 0x7f456c0b2fe0 2024-08-31T12:14:20.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456c0c1f40 con 0x7f456c0b2fe0 2024-08-31T12:14:20.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f45540046d0 con 0x7f456c0b2fe0 2024-08-31T12:14:20.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4569600640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 0x7f4548074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:20.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f455412cd90 con 0x7f456c0b2fe0 2024-08-31T12:14:20.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4570a00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 0x7f4548074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:20.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.192+0000 7f4570a00640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 0x7f4548074600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f455c009600 tx=0x7f455c0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:20.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.196+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4554016410 con 0x7f456c0b2fe0 2024-08-31T12:14:20.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f456c0c8a60 con 0x7f456c0b2fe0 2024-08-31T12:14:20.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4569600640 1 -- 172.21.15.164:0/342013239 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f45540f7cb0 con 0x7f456c0b2fe0 2024-08-31T12:14:20.400 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:20.401 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:20.401 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:20.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 msgr2=0x7f4548074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 0x7f4548074600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f455c009600 tx=0x7f455c0091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 msgr2=0x7f456c14ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45540190e0 tx=0x7f45540056d0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 shutdown_connections 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f45480720f0 0x7f4548074600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f456c0c2480 0x7f456c14d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f456c0b2fe0 0x7f456c14ac20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 --2- 172.21.15.164:0/342013239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f456c0b2900 0x7f456c14bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 >> 172.21.15.164:0/342013239 conn(0x7f456c0ccf20 msgr2=0x7f456c1490d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.396+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 shutdown_connections 2024-08-31T12:14:20.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:20.400+0000 7f4573400640 1 -- 172.21.15.164:0/342013239 wait complete. 2024-08-31T12:14:21.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T12:13:46.068757+0000', 'modified': '2024-08-31T12:14:11.045699+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4393': {'gid': 4393, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6835/2031819890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 2031819890}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 2031819890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4393, 'qdb_cluster': [4393]} 2024-08-31T12:14:21.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T12:14:21.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 -- 172.21.15.164:0/2885864072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c9330 msgr2=0x7fed20074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 --2- 172.21.15.164:0/2885864072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c9330 0x7fed20074720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed18009bc0 tx=0x7fed1801f3b0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 -- 172.21.15.164:0/2885864072 shutdown_connections 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 --2- 172.21.15.164:0/2885864072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c9330 0x7fed20074720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 --2- 172.21.15.164:0/2885864072 >> v2:172.21.15.184:3300/0 conn(0x7fed2015bc70 0x7fed20152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 -- 172.21.15.164:0/2885864072 >> 172.21.15.164:0/2885864072 conn(0x7fed200ccf20 msgr2=0x7fed200cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 -- 172.21.15.164:0/2885864072 shutdown_connections 2024-08-31T12:14:21.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.184+0000 7fed27200640 1 -- 172.21.15.164:0/2885864072 wait complete. 2024-08-31T12:14:21.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 Processor -- start 2024-08-31T12:14:21.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- start start 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 0x7fed201e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed2015bc70 0x7fed2014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed200c8030 con 0x7fed200c9330 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed200c3150 con 0x7fed2015bc70 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fed20074c60 con 0x7fed200c1f40 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 0x7fed201e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed25200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed2015bc70 0x7fed2014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 0x7fed201e3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.164:46186/0 (socket says 172.21.15.164:46186) 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32772/0 (socket says 172.21.15.164:32772) 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1fe00640 1 -- 172.21.15.164:0/812988668 learned_addr learned my addr 172.21.15.164:0/812988668 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 -- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 msgr2=0x7fed201e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 0x7fed201e3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 -- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed2015bc70 msgr2=0x7fed2014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed2015bc70 0x7fed2014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 -- 172.21.15.164:0/812988668 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed201e53d0 con 0x7fed200c9330 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed17400640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed08001650 tx=0x7fed08001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1cc00640 1 -- 172.21.15.164:0/812988668 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0800e2e0 con 0x7fed200c9330 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1cc00640 1 -- 172.21.15.164:0/812988668 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed08010630 con 0x7fed200c9330 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed201e56b0 con 0x7fed200c9330 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed1cc00640 1 -- 172.21.15.164:0/812988668 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08010aa0 con 0x7fed200c9330 2024-08-31T12:14:21.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.188+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201e47a0 con 0x7fed200c9330 2024-08-31T12:14:21.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed1cc00640 1 -- 172.21.15.164:0/812988668 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fed08010c40 con 0x7fed200c9330 2024-08-31T12:14:21.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed1cc00640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 0x7fecfc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed1cc00640 1 -- 172.21.15.164:0/812988668 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed08096ab0 con 0x7fed200c9330 2024-08-31T12:14:21.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed1fe00640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 0x7fecfc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed2e8c8000 1 Processor -- start 2024-08-31T12:14:21.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed2e8c8000 1 -- start start 2024-08-31T12:14:21.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.192+0000 7fed1fe00640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 0x7fecfc074600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed10009c40 tx=0x7fed100091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b7ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 0x55bc8b803b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b61f360 con 0x55bc8b6a6860 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b60e8f0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55bc8b6128a0 con 0x55bc8b2cd460 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32774/0 (socket says 172.21.15.164:32774) 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 -- 172.21.15.164:0/4228615488 learned_addr learned my addr 172.21.15.164:0/4228615488 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed1fe00640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b7ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed17400640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 0x55bc8b803b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 -- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 msgr2=0x55bc8b7ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b7ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 -- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 msgr2=0x55bc8b803b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 0x55bc8b803b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 -- 172.21.15.164:0/4228615488 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc8b5ae190 con 0x55bc8b6a6860 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed17400640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 0x55bc8b803b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed25200640 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed18009bc0 tx=0x7fed1801c150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c526c0e3d35457 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed14c00640 1 -- 172.21.15.164:0/4228615488 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180bf020 con 0x55bc8b6a6860 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed14c00640 1 -- 172.21.15.164:0/4228615488 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed18004d40 con 0x55bc8b6a6860 2024-08-31T12:14:21.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed14c00640 1 -- 172.21.15.164:0/4228615488 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180b4040 con 0x55bc8b6a6860 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- 172.21.15.164:0/4228615488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 msgr2=0x55bc8b804080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed18009bc0 tx=0x7fed1801c150 comp rx=0 tx=0).stop 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- 172.21.15.164:0/4228615488 shutdown_connections 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b804080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6bcd90 0x55bc8b803b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/4228615488 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b7ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- 172.21.15.164:0/4228615488 >> 172.21.15.164:0/4228615488 conn(0x55bc8b792ae0 msgr2=0x55bc8b802910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- 172.21.15.164:0/4228615488 shutdown_connections 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- 172.21.15.164:0/4228615488 wait complete. 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 -- start start 2024-08-31T12:14:21.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.196+0000 7fed2e8c8000 1 Processor -- start 2024-08-31T12:14:21.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7fea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b7ff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b5db500 con 0x55bc8b6a6860 2024-08-31T12:14:21.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b5dc190 con 0x55bc8b2cd460 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55bc8b611bb0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 10 client.0 _ll_register_callbacks cb 0x55bc8b7af100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32778/0 (socket says 172.21.15.164:32778) 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 -- 172.21.15.164:0/1965093204 learned_addr learned my addr 172.21.15.164:0/1965093204 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed25200640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b7ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 -- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 msgr2=0x55bc8b7ff500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b7ff500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 -- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 msgr2=0x55bc8b7fea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7fea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 -- 172.21.15.164:0/1965093204 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc8b5a9530 con 0x55bc8b6a6860 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed17400640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed0805e050 tx=0x7fed080614e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae09d74f5808ab31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08086070 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed08060ec0 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc8b5a8110 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7fed08066220 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 10 client.4749 fetch_fsmap learned FSMap version 10 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) -- 0x55bc8b693ff0 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bc8b5a8110 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 10) ==== 4720+0+0 (secure 0 0 0) 0x7fed08016070 con 0x55bc8b6a6860 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 10 client.4749 fetch_fsmap finished waiting for FSMap version 10 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 10 client.4749 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 20 client.4749 populate_metadata read hostname 'smithi164' 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2b27d0 0x55bc8b819dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 4 client.4749 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:14:21.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 --> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc8b6212b0 con 0x55bc8b2b27d0 2024-08-31T12:14:21.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2b27d0 0x55bc8b819dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2b27d0 0x55bc8b819dd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f189083ef0fb07b server_cookie=ed7e1884ad02a98b in_seq=0 out_seq=0 2024-08-31T12:14:21.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.200+0000 7fed0d600640 10 client.4749 ms_handle_connect on v2:172.21.15.164:6834/2031819890 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed0d600640 1 -- 172.21.15.164:0/1965093204 <== mds.0 v2:172.21.15.164:6834/2031819890 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc8b6212b0 con 0x55bc8b2b27d0 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed0d600640 10 client.4749 handle_command_reply: tid=0 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 client.4749 shutdown 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 msgr2=0x55bc8b7fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed0805e050 tx=0x7fed080614e0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 shutdown_connections 2024-08-31T12:14:21.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2b27d0 0x55bc8b819dd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b7ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7fefc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1965093204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed0d600640 0 client.4749 ms_handle_reset on v2:172.21.15.164:6834/2031819890 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 >> 172.21.15.164:0/1965093204 conn(0x55bc8b792ae0 msgr2=0x55bc8b8012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 shutdown_connections 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1965093204 wait complete. 2024-08-31T12:14:21.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.204+0000 7fed2e8c8000 20 client.4749 trim_cache size 0 max 16384 2024-08-31T12:14:21.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.220+0000 7fed2e8c8000 1 Processor -- start 2024-08-31T12:14:21.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.220+0000 7fed2e8c8000 1 -- start start 2024-08-31T12:14:21.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b81d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed201fad20 con 0x55bc8b6a6860 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed201fa1d0 con 0x55bc8b2cd460 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fed201fa6b0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32790/0 (socket says 172.21.15.164:32790) 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 -- 172.21.15.164:0/2711096978 learned_addr learned my addr 172.21.15.164:0/2711096978 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed1fe00640 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed25200640 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b81d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 -- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 msgr2=0x55bc8b81d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b81d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 -- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 msgr2=0x55bc8b7c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 -- 172.21.15.164:0/2711096978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc8b66b4b0 con 0x55bc8b6a6860 2024-08-31T12:14:21.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed17400640 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed08007fd0 tx=0x7fed08066150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1dcd3e4aa7d347 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed0fe00640 1 -- 172.21.15.164:0/2711096978 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08086040 con 0x55bc8b6a6860 2024-08-31T12:14:21.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed0fe00640 1 -- 172.21.15.164:0/2711096978 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed08060cc0 con 0x55bc8b6a6860 2024-08-31T12:14:21.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed0fe00640 1 -- 172.21.15.164:0/2711096978 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0806ac90 con 0x55bc8b6a6860 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- 172.21.15.164:0/2711096978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 msgr2=0x55bc8b7c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed08007fd0 tx=0x7fed08066150 comp rx=0 tx=0).stop 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- 172.21.15.164:0/2711096978 shutdown_connections 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b6bcd90 0x55bc8b81d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6a6860 0x55bc8b7c5830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/2711096978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b2cd460 0x55bc8b7c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- 172.21.15.164:0/2711096978 >> 172.21.15.164:0/2711096978 conn(0x55bc8b792ae0 msgr2=0x55bc8b7c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- 172.21.15.164:0/2711096978 shutdown_connections 2024-08-31T12:14:21.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- 172.21.15.164:0/2711096978 wait complete. 2024-08-31T12:14:21.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.224+0000 7fed2e8c8000 1 -- start start 2024-08-31T12:14:21.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 Processor -- start 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b87b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6a6860 0x55bc8b87bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b5c6340 con 0x55bc8b6bcd90 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bc8b616ed0 con 0x55bc8b6a6860 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55bc8b5cede0 con 0x55bc8b2cd460 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 10 client.0 _ll_register_callbacks cb 0x7fed08001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32794/0 (socket says 172.21.15.164:32794) 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 -- 172.21.15.164:0/1017876665 learned_addr learned my addr 172.21.15.164:0/1017876665 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed17400640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6a6860 0x55bc8b87bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b87b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 -- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 msgr2=0x55bc8b87b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b87b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 -- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6a6860 msgr2=0x55bc8b87bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6a6860 0x55bc8b87bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 -- 172.21.15.164:0/1017876665 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc8b5c8f30 con 0x55bc8b6bcd90 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b87b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed25200640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed18009bc0 tx=0x7fed1801f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2a00efc2a19184 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180b4070 con 0x55bc8b6bcd90 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed18004cd0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed08060cc0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7fed180bf040 con 0x55bc8b6bcd90 2024-08-31T12:14:21.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 10 client.4755 fetch_fsmap learned FSMap version 10 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) -- 0x55bc8b5b4590 con 0x55bc8b6bcd90 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed08060cc0 con 0x55bc8b6bcd90 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 10) ==== 4720+0+0 (secure 0 0 0) 0x7fed18003980 con 0x55bc8b6bcd90 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 10 client.4755 fetch_fsmap finished waiting for FSMap version 10 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 10 client.4755 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 20 client.4755 populate_metadata read hostname 'smithi164' 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2a0830 0x55bc8b81c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 4 client.4755 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 --> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] -- command(tid 0: {"prefix": "status"}) -- 0x55bc8b61cd50 con 0x55bc8b2a0830 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.228+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2a0830 0x55bc8b81c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed0d600640 10 client.4755 ms_handle_connect on v2:172.21.15.164:6834/2031819890 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed1fe00640 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2a0830 0x55bc8b81c2d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e9cf9722d2f1b7 server_cookie=c678e257bac78fdd in_seq=0 out_seq=0 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed0d600640 1 -- 172.21.15.164:0/1017876665 <== mds.0 v2:172.21.15.164:6834/2031819890 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bc8b61cd50 con 0x55bc8b2a0830 2024-08-31T12:14:21.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed0d600640 10 client.4755 handle_command_reply: tid=0 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 client.4755 shutdown 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 msgr2=0x55bc8b87c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed18009bc0 tx=0x7fed1801f600 comp rx=0 tx=0).stop 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 shutdown_connections 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:6834/2031819890,v1:172.21.15.164:6835/2031819890] conn(0x55bc8b2a0830 0x55bc8b81c2d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc8b6bcd90 0x55bc8b87c150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bc8b6a6860 0x55bc8b87bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 --2- 172.21.15.164:0/1017876665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55bc8b2cd460 0x55bc8b87b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed0d600640 0 client.4755 ms_handle_reset on v2:172.21.15.164:6834/2031819890 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 >> 172.21.15.164:0/1017876665 conn(0x55bc8b792ae0 msgr2=0x55bc8b7c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 shutdown_connections 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 1 -- 172.21.15.164:0/1017876665 wait complete. 2024-08-31T12:14:21.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed2e8c8000 20 client.4755 trim_cache size 0 max 16384 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "0ef23008-1eb0-48b8-823b-3324ee9f8086", 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 0, 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4393, 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-08-31T12:14:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 34.549601053000004, 2024-08-31T12:14:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 10, 2024-08-31T12:14:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 27, 2024-08-31T12:14:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 27, 2024-08-31T12:14:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 40.206324684000002 2024-08-31T12:14:21.241 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 msgr2=0x7fecfc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 0x7fecfc074600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed10009c40 tx=0x7fed100091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 msgr2=0x7fed20157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed08001650 tx=0x7fed08001b10 comp rx=0 tx=0).stop 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 shutdown_connections 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fecfc0720f0 0x7fecfc074600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed2015bc70 0x7fed2014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed200c9330 0x7fed20157ba0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 --2- 172.21.15.164:0/812988668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed200c1f40 0x7fed201e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 >> 172.21.15.164:0/812988668 conn(0x7fed200ccf20 msgr2=0x7fed200c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 shutdown_connections 2024-08-31T12:14:21.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.232+0000 7fed27200640 1 -- 172.21.15.164:0/812988668 wait complete. 2024-08-31T12:14:21.256 INFO:teuthology.run_tasks:Running task kclient... 2024-08-31T12:14:21.276 INFO:tasks.kclient:Mounting kernel clients... 2024-08-31T12:14:21.276 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-31T12:14:21.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:21.277 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-08-31T12:14:21.286 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-31T12:14:21.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:21.287 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T12:14:21.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:21.352 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-08-31T12:14:21.830 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-31T12:14:21.830 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T12:14:21.830 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:21.830 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-31T12:14:21.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 -- 172.21.15.164:0/463249918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 msgr2=0x7f98a4152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 --2- 172.21.15.164:0/463249918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a4152a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98a40c9020 tx=0x7f989401f0d0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 -- 172.21.15.164:0/463249918 shutdown_connections 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 --2- 172.21.15.164:0/463249918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 0x7f98a40c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 --2- 172.21.15.164:0/463249918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a4152a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 -- 172.21.15.164:0/463249918 >> 172.21.15.164:0/463249918 conn(0x7f98a40ccf20 msgr2=0x7f98a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 -- 172.21.15.164:0/463249918 shutdown_connections 2024-08-31T12:14:21.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.980+0000 7f98aa000640 1 -- 172.21.15.164:0/463249918 wait complete. 2024-08-31T12:14:21.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 Processor -- start 2024-08-31T12:14:21.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- start start 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 0x7f98a41f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a40c7920 0x7f98a41597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f98a4074fb0 con 0x7f98a415bc70 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98a4074e30 con 0x7f98a40c7920 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f98a40c7d30 con 0x7f98a40c1f40 2024-08-31T12:14:21.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32812/0 (socket says 172.21.15.164:32812) 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 -- 172.21.15.164:0/2080349474 learned_addr learned my addr 172.21.15.164:0/2080349474 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f989be00640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a40c7920 0x7f98a41597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3400640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 0x7f98a41f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 -- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 msgr2=0x7f98a41f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 0x7f98a41f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 -- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a40c7920 msgr2=0x7f98a41597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a40c7920 0x7f98a41597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 -- 172.21.15.164:0/2080349474 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a41f5cf0 con 0x7f98a415bc70 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98a3e00640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c760 tx=0x7f989c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c003b80 con 0x7f98a415bc70 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f989c003d20 con 0x7f98a415bc70 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c00aab0 con 0x7f98a415bc70 2024-08-31T12:14:21.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a40c6550 con 0x7f98a415bc70 2024-08-31T12:14:21.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.984+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a4073e60 con 0x7f98a415bc70 2024-08-31T12:14:21.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.988+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a40c9330 con 0x7f98a415bc70 2024-08-31T12:14:21.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.988+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f989c00ac50 con 0x7f98a415bc70 2024-08-31T12:14:21.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.988+0000 7f989b400640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 0x7f9880074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:21.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.988+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f989c092c00 con 0x7f98a415bc70 2024-08-31T12:14:21.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.988+0000 7f98a3400640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 0x7f9880074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:21.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.992+0000 7f98a3400640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 0x7f9880074600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98940b2000 tx=0x7f989401d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:21.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:21.992+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f989c05da90 con 0x7f98a415bc70 2024-08-31T12:14:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.192+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f98a41560a0 con 0x7f98a415bc70 2024-08-31T12:14:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.192+0000 7f989b400640 1 -- 172.21.15.164:0/2080349474 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) ==== 53+0+88 (secure 0 0 0) 0x7f989c062250 con 0x7f98a415bc70 2024-08-31T12:14:22.198 INFO:teuthology.orchestra.run.smithi164.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 msgr2=0x7f9880074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 0x7f9880074600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98940b2000 tx=0x7f989401d910 comp rx=0 tx=0).stop 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 msgr2=0x7f98a414c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c760 tx=0x7f989c00cc20 comp rx=0 tx=0).stop 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 shutdown_connections 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f98800720f0 0x7f9880074600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a415bc70 0x7f98a414c850 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a40c7920 0x7f98a41597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 --2- 172.21.15.164:0/2080349474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a40c1f40 0x7f98a41f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 >> 172.21.15.164:0/2080349474 conn(0x7f98a40ccf20 msgr2=0x7f98a414fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 shutdown_connections 2024-08-31T12:14:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22.196+0000 7f98aa000640 1 -- 172.21.15.164:0/2080349474 wait complete. 2024-08-31T12:14:22.220 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T12:14:22.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T12:14:22.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-08-31T12:14:22.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T12:14:22.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:22.221 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T12:14:22.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T12:14:22.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T12:14:22.221 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T12:14:22.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:22.221 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:14:22.230 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:14:22.231 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-31T12:14:22.232 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:1b:65:5d:24 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:14:22.232 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-31T12:14:22.232 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:14:22.233 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T12:14:22.233 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:14:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:22.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:22.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:22.391 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T12:14:22.452 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-08-31T12:14:22.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:22.454 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-08-31T12:14:22.510 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-08-31T12:14:22.510 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T12:14:22.510 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T12:14:22.511 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T12:14:22.511 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:14:22.511 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:14:22.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T12:14:22.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T12:14:22.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T12:14:22.512 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:14:22.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:22.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:22.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:22.651 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-08-31T12:14:22.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:22.660 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-08-31T12:14:22.715 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:14:22.715 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:14:22.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:14:22.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T12:14:22.715 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:14:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:22.841 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T12:14:22.841 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:14:22.841 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T12:14:22.842 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:14:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:22.980 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:14:22.980 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-08-31T12:14:22.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-08-31T12:14:22.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T12:14:22.980 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-08-31T12:14:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:23.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:14:23.063 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:23.072 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T12:14:23.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:14:23.072 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:23.125 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-31T12:14:23.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:23.125 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-31T12:14:23.229 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-31T12:14:23.230 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-31T12:14:23.953 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-31T12:14:23.953 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-31T12:14:23.953 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.164:3300,172.21.15.184:3300,172.21.15.184:3301" 2024-08-31T12:14:23.953 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with new device syntax: 0@0ef23008-1eb0-48b8-823b-3324ee9f8086.cephfs=/ 2024-08-31T12:14:23.953 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.164:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2024-08-31T12:14:23.957 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-31T12:14:23.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:14:23.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:23.977 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T12:14:24.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T12:14:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:24.080 INFO:teuthology.orchestra.run.smithi164.stdout:client4764 2024-08-31T12:14:24.081 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:14:24.081 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:14:24.089 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T12:14:24.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T12:14:24.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:24.187 INFO:teuthology.orchestra.run.smithi164.stdout:client4764 2024-08-31T12:14:24.188 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T12:14:24.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T12:14:24.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:24.282 INFO:teuthology.orchestra.run.smithi164.stdout:client4764 2024-08-31T12:14:24.282 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0ef23008-1eb0-48b8-823b-3324ee9f8086.client4764/status') 2024-08-31T12:14:24.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:14:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4764 (3)192.168.0.1:0/2611331282 2024-08-31T12:14:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2024-08-31T12:14:24.341 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2024-08-31T12:14:24.341 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2024-08-31T12:14:24.341 INFO:teuthology.orchestra.run.smithi164.stderr:69 bytes copied, 6.028e-05 s, 1.1 MB/s 2024-08-31T12:14:24.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:14:24.349 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-08-31T12:14:24.362 INFO:tasks.mds_thrash:mds thrasher using random seed: 1725106464 2024-08-31T12:14:24.362 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:24.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- 172.21.15.164:0/1722652758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c156e10 msgr2=0x7f1f2c0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 --2- 172.21.15.164:0/1722652758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c156e10 0x7f1f2c0c8d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009840 tx=0x7f1f1801f010 comp rx=0 tx=0).stop 2024-08-31T12:14:24.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- 172.21.15.164:0/1722652758 shutdown_connections 2024-08-31T12:14:24.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 --2- 172.21.15.164:0/1722652758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c156e10 0x7f1f2c0c8d70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- 172.21.15.164:0/1722652758 >> 172.21.15.164:0/1722652758 conn(0x7f1f2c0ccf20 msgr2=0x7f1f2c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- 172.21.15.164:0/1722652758 shutdown_connections 2024-08-31T12:14:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- 172.21.15.164:0/1722652758 wait complete. 2024-08-31T12:14:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 Processor -- start 2024-08-31T12:14:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.512+0000 7f1f34000640 1 -- start start 2024-08-31T12:14:24.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f2c0c92b0 0x7f1f2c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2c156e10 0x7f1f2c14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c1599b0 con 0x7f1f2c074e20 2024-08-31T12:14:24.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c15a2e0 con 0x7f1f2c156e10 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c159c90 con 0x7f1f2c0c92b0 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32834/0 (socket says 172.21.15.164:32834) 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 -- 172.21.15.164:0/4186552343 learned_addr learned my addr 172.21.15.164:0/4186552343 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f30c00640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f2c0c92b0 0x7f1f2c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f32000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2c156e10 0x7f1f2c14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 -- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f2c0c92b0 msgr2=0x7f1f2c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f2c0c92b0 0x7f1f2c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 -- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2c156e10 msgr2=0x7f1f2c14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2c156e10 0x7f1f2c14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 -- 172.21.15.164:0/4186552343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0cc790 con 0x7f1f2c074e20 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f31600640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c430 tx=0x7f1f2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20011790 con 0x7f1f2c074e20 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f20017070 con 0x7f1f2c074e20 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c0cadc0 con 0x7f1f2c074e20 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20011ca0 con 0x7f1f2c074e20 2024-08-31T12:14:24.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c0cb380 con 0x7f1f2c074e20 2024-08-31T12:14:24.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.516+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c157220 con 0x7f1f2c074e20 2024-08-31T12:14:24.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.520+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f1f2001c460 con 0x7f1f2c074e20 2024-08-31T12:14:24.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.520+0000 7f1f29600640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 0x7f1f0c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.520+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1f20092c10 con 0x7f1f2c074e20 2024-08-31T12:14:24.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.520+0000 7f1f30c00640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 0x7f1f0c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.520+0000 7f1f30c00640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 0x7f1f0c0745d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f180b2000 tx=0x7f1f1801d850 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:24.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.524+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1f2005e180 con 0x7f1f2c074e20 2024-08-31T12:14:24.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.692+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f2c074c00 con 0x7f1f2c074e20 2024-08-31T12:14:24.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.692+0000 7f1f29600640 1 -- 172.21.15.164:0/4186552343 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18662 (secure 0 0 0) 0x7f1f2005da80 con 0x7f1f2c074e20 2024-08-31T12:14:24.697 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:24.697 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:13:51.122430+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:24.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 msgr2=0x7f1f0c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 0x7f1f0c0745d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f180b2000 tx=0x7f1f1801d850 comp rx=0 tx=0).stop 2024-08-31T12:14:24.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 msgr2=0x7f1f2c0c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c430 tx=0x7f1f2000c8f0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 shutdown_connections 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f1f0c0720c0 0x7f1f0c0745d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2c156e10 0x7f1f2c14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f2c0c92b0 0x7f1f2c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 --2- 172.21.15.164:0/4186552343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c074e20 0x7f1f2c0c2ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 >> 172.21.15.164:0/4186552343 conn(0x7f1f2c0ccf20 msgr2=0x7f1f2c153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 shutdown_connections 2024-08-31T12:14:24.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.696+0000 7f1f34000640 1 -- 172.21.15.164:0/4186552343 wait complete. 2024-08-31T12:14:24.719 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T12:13:36.572013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T12:13:44.435605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T12:13:45.013335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-31T12:13:48.695161+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-31T12:14:24.720 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T12:14:24.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 -- 172.21.15.164:0/3140191352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 msgr2=0x7fda640c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 --2- 172.21.15.164:0/3140191352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda640c1ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda50009840 tx=0x7fda5001c790 comp rx=0 tx=0).stop 2024-08-31T12:14:24.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 -- 172.21.15.164:0/3140191352 shutdown_connections 2024-08-31T12:14:24.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 --2- 172.21.15.164:0/3140191352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda640c1ed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 --2- 172.21.15.164:0/3140191352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640c90e0 0x7fda640747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 -- 172.21.15.164:0/3140191352 >> 172.21.15.164:0/3140191352 conn(0x7fda640c99b0 msgr2=0x7fda640c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:24.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 -- 172.21.15.164:0/3140191352 shutdown_connections 2024-08-31T12:14:24.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.872+0000 7fda6c000640 1 -- 172.21.15.164:0/3140191352 wait complete. 2024-08-31T12:14:24.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 Processor -- start 2024-08-31T12:14:24.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- start start 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640b2860 0x7fda64161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda640c90e0 0x7fda64142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fda64165770 con 0x7fda640b2d20 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fda641658f0 con 0x7fda640c90e0 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fda64165a70 con 0x7fda640b2860 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32864/0 (socket says 172.21.15.164:32864) 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 -- 172.21.15.164:0/2560513147 learned_addr learned my addr 172.21.15.164:0/2560513147 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda69600640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640b2860 0x7fda64161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6a000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda640c90e0 0x7fda64142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 -- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640b2860 msgr2=0x7fda64161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640b2860 0x7fda64161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 -- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda640c90e0 msgr2=0x7fda64142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda640c90e0 0x7fda64142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 -- 172.21.15.164:0/2560513147 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda641616d0 con 0x7fda640b2d20 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda68c00640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda5001a3c0 tx=0x7fda500a64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500ac070 con 0x7fda640b2d20 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda500a6b80 con 0x7fda640b2d20 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda641470c0 con 0x7fda640b2d20 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50003600 con 0x7fda640b2d20 2024-08-31T12:14:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.876+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda64148480 con 0x7fda640b2d20 2024-08-31T12:14:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.880+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda640c1ed0 con 0x7fda640b2d20 2024-08-31T12:14:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.880+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fda500af070 con 0x7fda640b2d20 2024-08-31T12:14:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.880+0000 7fda61600640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 0x7fda44074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:24.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.880+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fda5012d6d0 con 0x7fda640b2d20 2024-08-31T12:14:24.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.880+0000 7fda69600640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 0x7fda44074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:24.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.884+0000 7fda69600640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 0x7fda44074600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f70 tx=0x7fda58009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:24.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:24.884+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fda50016410 con 0x7fda640b2d20 2024-08-31T12:14:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.052+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda64156b80 con 0x7fda640b2d20 2024-08-31T12:14:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda61600640 1 -- 172.21.15.164:0/2560513147 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fda500f8600 con 0x7fda640b2d20 2024-08-31T12:14:25.059 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-08-31T12:14:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 msgr2=0x7fda44074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 0x7fda44074600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f70 tx=0x7fda58009040 comp rx=0 tx=0).stop 2024-08-31T12:14:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 msgr2=0x7fda64149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda5001a3c0 tx=0x7fda500a64e0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 shutdown_connections 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda440720f0 0x7fda44074600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda640c90e0 0x7fda64142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda640b2d20 0x7fda64149080 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 --2- 172.21.15.164:0/2560513147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda640b2860 0x7fda64161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 >> 172.21.15.164:0/2560513147 conn(0x7fda640c99b0 msgr2=0x7fda64156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 shutdown_connections 2024-08-31T12:14:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.056+0000 7fda6c000640 1 -- 172.21.15.164:0/2560513147 wait complete. 2024-08-31T12:14:25.081 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 -- 172.21.15.164:0/594778351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 msgr2=0x7f6d040747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 --2- 172.21.15.164:0/594778351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d040747b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009840 tx=0x7f6cfc01c680 comp rx=0 tx=0).stop 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 -- 172.21.15.164:0/594778351 shutdown_connections 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 --2- 172.21.15.164:0/594778351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d040747b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 --2- 172.21.15.164:0/594778351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040b2860 0x7f6d040b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 -- 172.21.15.164:0/594778351 >> 172.21.15.164:0/594778351 conn(0x7f6d040c99b0 msgr2=0x7f6d040c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 -- 172.21.15.164:0/594778351 shutdown_connections 2024-08-31T12:14:25.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.232+0000 7f6d0be00640 1 -- 172.21.15.164:0/594778351 wait complete. 2024-08-31T12:14:25.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 Processor -- start 2024-08-31T12:14:25.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 -- start start 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040c1ed0 0x7f6d04150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d0414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d04158750 con 0x7f6d040b2860 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041585d0 con 0x7f6d040c90e0 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d0be00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6d04165770 con 0x7f6d040c1ed0 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32872/0 (socket says 172.21.15.164:32872) 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 -- 172.21.15.164:0/2165422945 learned_addr learned my addr 172.21.15.164:0/2165422945 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d08a00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040c1ed0 0x7f6d04150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09e00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d0414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 -- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040c1ed0 msgr2=0x7f6d04150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040c1ed0 0x7f6d04150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 -- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 msgr2=0x7f6d0414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d0414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 -- 172.21.15.164:0/2165422945 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d040c63c0 con 0x7f6d040b2860 2024-08-31T12:14:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d09400640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800eb30 tx=0x7f6cf800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.236+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8004b30 con 0x7f6d040b2860 2024-08-31T12:14:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf8004cf0 con 0x7f6d040b2860 2024-08-31T12:14:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0414c1a0 con 0x7f6d040b2860 2024-08-31T12:14:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8005280 con 0x7f6d040b2860 2024-08-31T12:14:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041f5730 con 0x7f6d040b2860 2024-08-31T12:14:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d040b2d20 con 0x7f6d040b2860 2024-08-31T12:14:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6cf8005420 con 0x7f6d040b2860 2024-08-31T12:14:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d01600640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 0x7f6ce4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6cf8093b50 con 0x7f6d040b2860 2024-08-31T12:14:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.240+0000 7f6d08a00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 0x7f6ce4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.244+0000 7f6d08a00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 0x7f6ce4074600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d040cc540 tx=0x7f6cf0009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.244+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6cf805f0c0 con 0x7f6d040b2860 2024-08-31T12:14:25.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6d04073940 con 0x7f6d040b2860 2024-08-31T12:14:25.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d01600640 1 -- 172.21.15.164:0/2165422945 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6cf805e9c0 con 0x7f6d040b2860 2024-08-31T12:14:25.416 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 msgr2=0x7f6ce4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 0x7f6ce4074600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d040cc540 tx=0x7f6cf0009040 comp rx=0 tx=0).stop 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 msgr2=0x7f6d040c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800eb30 tx=0x7f6cf800c2d0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 shutdown_connections 2024-08-31T12:14:25.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6ce40720f0 0x7f6ce4074600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d040c90e0 0x7f6d0414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d040c1ed0 0x7f6d04150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 --2- 172.21.15.164:0/2165422945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d040b2860 0x7f6d040c5e80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 >> 172.21.15.164:0/2165422945 conn(0x7f6d040c99b0 msgr2=0x7f6d040745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 shutdown_connections 2024-08-31T12:14:25.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.412+0000 7f6d0be00640 1 -- 172.21.15.164:0/2165422945 wait complete. 2024-08-31T12:14:25.439 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T12:14:25.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 -- 172.21.15.164:0/1413410521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb49c005260 msgr2=0x7fb49c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 --2- 172.21.15.164:0/1413410521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb49c005260 0x7fb49c00b9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00016c0 tx=0x7fb4b001c790 comp rx=0 tx=0).stop 2024-08-31T12:14:25.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 -- 172.21.15.164:0/1413410521 shutdown_connections 2024-08-31T12:14:25.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 --2- 172.21.15.164:0/1413410521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb49c005260 0x7fb49c00b9d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 -- 172.21.15.164:0/1413410521 >> 172.21.15.164:0/1413410521 conn(0x7fb4b80c99b0 msgr2=0x7fb4b80c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 -- 172.21.15.164:0/1413410521 shutdown_connections 2024-08-31T12:14:25.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 -- 172.21.15.164:0/1413410521 wait complete. 2024-08-31T12:14:25.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.592+0000 7fb4bf400640 1 Processor -- start 2024-08-31T12:14:25.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 -- start start 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb49c005260 0x7fb4b8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4b8155c40 0x7fb4b81f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8073e70 con 0x7fb4b80c32e0 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8073b90 con 0x7fb4b8155c40 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b8069fc0 con 0x7fb49c005260 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bca00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb49c005260 0x7fb4b8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38554/0 (socket says 172.21.15.164:38554) 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 -- 172.21.15.164:0/2869098646 learned_addr learned my addr 172.21.15.164:0/2869098646 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:25.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4b7e00640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4b8155c40 0x7fb4b81f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 -- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb49c005260 msgr2=0x7fb4b8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb49c005260 0x7fb4b8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 -- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4b8155c40 msgr2=0x7fb4b81f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4b8155c40 0x7fb4b81f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 -- 172.21.15.164:0/2869098646 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b8159e50 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bd400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb4b001d030 tx=0x7fb4b00a6c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0001310 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4b0003920 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0006930 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.596+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b8154240 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b81544e0 con 0x7fb4b80c32e0 2024-08-31T12:14:25.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b815a530 con 0x7fb4b80c32e0 2024-08-31T12:14:25.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb4b00b1430 con 0x7fb4b80c32e0 2024-08-31T12:14:25.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4b4c00640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 0x7fb498074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb4b012d0a0 con 0x7fb4b80c32e0 2024-08-31T12:14:25.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.600+0000 7fb4bca00640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 0x7fb498074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.604+0000 7fb4bca00640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 0x7fb498074600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8001c30 tx=0x7fb4a8006040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.604+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb4b8154240 con 0x7fb4b80c32e0 2024-08-31T12:14:25.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.772+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb4b8071930 con 0x7fb4b80c32e0 2024-08-31T12:14:25.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4b4c00640 1 -- 172.21.15.164:0/2869098646 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb4b00164f0 con 0x7fb4b80c32e0 2024-08-31T12:14:25.779 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 msgr2=0x7fb498074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 0x7fb498074600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8001c30 tx=0x7fb4a8006040 comp rx=0 tx=0).stop 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 msgr2=0x7fb4b8149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb4b001d030 tx=0x7fb4b00a6c40 comp rx=0 tx=0).stop 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 shutdown_connections 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb4980720f0 0x7fb498074600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4b80c32e0 0x7fb4b8149620 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4b8155c40 0x7fb4b81f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 --2- 172.21.15.164:0/2869098646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb49c005260 0x7fb4b8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 >> 172.21.15.164:0/2869098646 conn(0x7fb4b80c99b0 msgr2=0x7fb4b814da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 shutdown_connections 2024-08-31T12:14:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.776+0000 7fb4bf400640 1 -- 172.21.15.164:0/2869098646 wait complete. 2024-08-31T12:14:25.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-31T12:14:25.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 -- 172.21.15.164:0/3403409256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0441588b0 msgr2=0x7fc044070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 --2- 172.21.15.164:0/3403409256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0441588b0 0x7fc044070190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc044075090 tx=0x7fc03c01f390 comp rx=0 tx=0).stop 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 -- 172.21.15.164:0/3403409256 shutdown_connections 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 --2- 172.21.15.164:0/3403409256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0441588b0 0x7fc044070190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 --2- 172.21.15.164:0/3403409256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc044151dc0 0x7fc0440749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 -- 172.21.15.164:0/3403409256 >> 172.21.15.164:0/3403409256 conn(0x7fc0440c99b0 msgr2=0x7fc0440c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 -- 172.21.15.164:0/3403409256 shutdown_connections 2024-08-31T12:14:25.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 -- 172.21.15.164:0/3403409256 wait complete. 2024-08-31T12:14:25.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.952+0000 7fc049400640 1 Processor -- start 2024-08-31T12:14:25.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- start start 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04406fd80 0x7fc0441efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0441588b0 0x7fc0440c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440c2770 con 0x7fc044151dc0 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440c2490 con 0x7fc04406fd80 2024-08-31T12:14:25.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc0441521d0 con 0x7fc0441588b0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38578/0 (socket says 172.21.15.164:38578) 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 -- 172.21.15.164:0/3388407968 learned_addr learned my addr 172.21.15.164:0/3388407968 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc043200640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0441588b0 0x7fc0440c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc042800640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04406fd80 0x7fc0441efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 -- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0441588b0 msgr2=0x7fc0440c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0441588b0 0x7fc0440c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 -- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04406fd80 msgr2=0x7fc0441efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04406fd80 0x7fc0441efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 -- 172.21.15.164:0/3388407968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0440cbf40 con 0x7fc044151dc0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc041e00640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c460 tx=0x7fc03000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030011790 con 0x7fc044151dc0 2024-08-31T12:14:25.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc030017070 con 0x7fc044151dc0 2024-08-31T12:14:25.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0440cc1d0 con 0x7fc044151dc0 2024-08-31T12:14:25.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030011ce0 con 0x7fc044151dc0 2024-08-31T12:14:25.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0440cbc60 con 0x7fc044151dc0 2024-08-31T12:14:25.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.956+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0440c3f80 con 0x7fc044151dc0 2024-08-31T12:14:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.960+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc03001c460 con 0x7fc044151dc0 2024-08-31T12:14:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.960+0000 7fc03aa00640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 0x7fc024074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.960+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc030092ce0 con 0x7fc044151dc0 2024-08-31T12:14:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.960+0000 7fc042800640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 0x7fc024074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.960+0000 7fc042800640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 0x7fc024074600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc0340058d0 tx=0x7fc034005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:25.964+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc03005e3a0 con 0x7fc044151dc0 2024-08-31T12:14:26.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.128+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc0440c2ec0 con 0x7fc044151dc0 2024-08-31T12:14:26.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc03aa00640 1 -- 172.21.15.164:0/3388407968 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc03005dca0 con 0x7fc044151dc0 2024-08-31T12:14:26.135 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 msgr2=0x7fc024074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 0x7fc024074600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc0340058d0 tx=0x7fc034005860 comp rx=0 tx=0).stop 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 msgr2=0x7fc0440c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c460 tx=0x7fc03000c920 comp rx=0 tx=0).stop 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 shutdown_connections 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc0240720f0 0x7fc024074600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0441588b0 0x7fc0440c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc044151dc0 0x7fc0440c4e50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 --2- 172.21.15.164:0/3388407968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04406fd80 0x7fc0441efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 >> 172.21.15.164:0/3388407968 conn(0x7fc0440c99b0 msgr2=0x7fc044155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:26.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 shutdown_connections 2024-08-31T12:14:26.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.132+0000 7fc049400640 1 -- 172.21.15.164:0/3388407968 wait complete. 2024-08-31T12:14:26.156 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-08-31T12:14:26.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 -- 172.21.15.164:0/810944487 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a80004d50 msgr2=0x7f5a80005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 --2- 172.21.15.164:0/810944487 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a80004d50 0x7f5a80005200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a980b4470 tx=0x7f5a9001d590 comp rx=0 tx=0).stop 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9d600640 1 -- 172.21.15.164:0/810944487 reap_dead start 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 -- 172.21.15.164:0/810944487 shutdown_connections 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 -- 172.21.15.164:0/810944487 >> 172.21.15.164:0/810944487 conn(0x7f5a98071be0 msgr2=0x7f5a9806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 -- 172.21.15.164:0/810944487 shutdown_connections 2024-08-31T12:14:26.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.308+0000 7f5a9f600640 1 -- 172.21.15.164:0/810944487 wait complete. 2024-08-31T12:14:26.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 Processor -- start 2024-08-31T12:14:26.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- start start 2024-08-31T12:14:26.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 0x7f5a98155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a9815d120 0x7f5a9815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5a980cabf0 con 0x7f5a981f3230 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5a98159ad0 con 0x7f5a9815d120 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9808cff0 con 0x7f5a80004d50 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38588/0 (socket says 172.21.15.164:38588) 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 -- 172.21.15.164:0/3872871706 learned_addr learned my addr 172.21.15.164:0/3872871706 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a97e00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a9815d120 0x7f5a9815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9cc00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 0x7f5a98155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 -- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 msgr2=0x7f5a98155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 0x7f5a98155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 -- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a9815d120 msgr2=0x7f5a9815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a9815d120 0x7f5a9815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 -- 172.21.15.164:0/3872871706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9815d920 con 0x7f5a981f3230 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9cc00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 0x7f5a98155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9d600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a9001d000 tx=0x7f5a90004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a90009a90 con 0x7f5a981f3230 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a900a94d0 con 0x7f5a981f3230 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9806fb50 con 0x7f5a981f3230 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a9cb0 con 0x7f5a981f3230 2024-08-31T12:14:26.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.312+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a981f6200 con 0x7f5a981f3230 2024-08-31T12:14:26.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.316+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a980c5160 con 0x7f5a981f3230 2024-08-31T12:14:26.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.316+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5a90005040 con 0x7f5a981f3230 2024-08-31T12:14:26.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.316+0000 7f5a94c00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 0x7f5a780745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.316+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5a9012e3f0 con 0x7f5a981f3230 2024-08-31T12:14:26.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.316+0000 7f5a9cc00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 0x7f5a780745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.320+0000 7f5a9cc00640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 0x7f5a780745d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000fc0 tx=0x7f5a8c001690 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.320+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5a900ad070 con 0x7f5a981f3230 2024-08-31T12:14:26.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.520+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a98076770 con 0x7f5a981f3230 2024-08-31T12:14:26.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a94c00640 1 -- 172.21.15.164:0/3872871706 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f5a900172a0 con 0x7f5a981f3230 2024-08-31T12:14:26.527 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:26.528 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:26.528 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:26.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 msgr2=0x7f5a780745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 0x7f5a780745d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000fc0 tx=0x7f5a8c001690 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 msgr2=0x7f5a98151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a9001d000 tx=0x7f5a90004f50 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 shutdown_connections 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5a780720c0 0x7f5a780745d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a981f3230 0x7f5a98151720 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a9815d120 0x7f5a9815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 --2- 172.21.15.164:0/3872871706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a80004d50 0x7f5a98155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 >> 172.21.15.164:0/3872871706 conn(0x7f5a98071be0 msgr2=0x7f5a980cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 shutdown_connections 2024-08-31T12:14:26.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.524+0000 7f5a9f600640 1 -- 172.21.15.164:0/3872871706 wait complete. 2024-08-31T12:14:26.550 INFO:tasks.mds_thrash:Ready to start thrashing 2024-08-31T12:14:26.550 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-08-31T12:14:26.550 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:26.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- 172.21.15.164:0/3315038312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 msgr2=0x7fb310163e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 --2- 172.21.15.164:0/3315038312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310163e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb308009bc0 tx=0x7fb30801cba0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- 172.21.15.164:0/3315038312 shutdown_connections 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 --2- 172.21.15.164:0/3315038312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310163e00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- 172.21.15.164:0/3315038312 >> 172.21.15.164:0/3315038312 conn(0x7fb310071f20 msgr2=0x7fb310072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- 172.21.15.164:0/3315038312 shutdown_connections 2024-08-31T12:14:26.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- 172.21.15.164:0/3315038312 wait complete. 2024-08-31T12:14:26.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 Processor -- start 2024-08-31T12:14:26.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.716+0000 7fb30fe00640 1 -- start start 2024-08-31T12:14:26.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3100c5120 0x7fb31014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 0x7fb310150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb3100c58c0 con 0x7fb310152430 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb310070df0 con 0x7fb3100c5120 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb310152840 con 0x7fb3100c7b00 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38608/0 (socket says 172.21.15.164:38608) 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 -- 172.21.15.164:0/1584744009 learned_addr learned my addr 172.21.15.164:0/1584744009 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30ea00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3100c5120 0x7fb31014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 -- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 msgr2=0x7fb310150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30e000640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 0x7fb310150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 0x7fb310150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 -- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3100c5120 msgr2=0x7fb31014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3100c5120 0x7fb31014cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 -- 172.21.15.164:0/1584744009 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31014d4b0 con 0x7fb310152430 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30e000640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 0x7fb310150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30f400640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb308009b10 tx=0x7fb3080a5ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3080bb070 con 0x7fb310152430 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb308004b40 con 0x7fb310152430 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3080b2040 con 0x7fb310152430 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb310152e60 con 0x7fb310152430 2024-08-31T12:14:26.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb310146530 con 0x7fb310152430 2024-08-31T12:14:26.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.720+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3100c7320 con 0x7fb310152430 2024-08-31T12:14:26.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.724+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb3080040c0 con 0x7fb310152430 2024-08-31T12:14:26.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.724+0000 7fb306a00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 0x7fb2f0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:26.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.724+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fb30812cd90 con 0x7fb310152430 2024-08-31T12:14:26.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.724+0000 7fb30ea00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 0x7fb2f0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:26.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.724+0000 7fb30ea00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 0x7fb2f0074600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb300000f70 tx=0x7fb300009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:26.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.728+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb308016790 con 0x7fb310152430 2024-08-31T12:14:26.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.892+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb310158450 con 0x7fb2f00720f0 2024-08-31T12:14:26.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.908+0000 7fb306a00640 1 -- 172.21.15.164:0/1584744009 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7fb310158450 con 0x7fb2f00720f0 2024-08-31T12:14:26.917 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:26.919 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 msgr2=0x7fb2f0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 0x7fb2f0074600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb300000f70 tx=0x7fb300009040 comp rx=0 tx=0).stop 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 msgr2=0x7fb310143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb308009b10 tx=0x7fb3080a5ac0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 shutdown_connections 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb2f00720f0 0x7fb2f0074600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb310152430 0x7fb310143cc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3100c7b00 0x7fb310150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 --2- 172.21.15.164:0/1584744009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3100c5120 0x7fb31014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 >> 172.21.15.164:0/1584744009 conn(0x7fb310071f20 msgr2=0x7fb31014f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 shutdown_connections 2024-08-31T12:14:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:26.912+0000 7fb30fe00640 1 -- 172.21.15.164:0/1584744009 wait complete. 2024-08-31T12:14:26.938 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-08-31T12:14:26.612085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595267,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":151,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":259,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.070480"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:23.949922+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:23.949922+0000","last_peered":"2024-08-31T12:14:23.949922+0000","last_clean":"2024-08-31T12:14:23.949922+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:23.949922+0000","last_undegraded":"2024-08-31T12:14:23.949922+0000","last_fullsized":"2024-08-31T12:14:23.949922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4101,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4899,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:26.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 -- 172.21.15.164:0/3811995758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 msgr2=0x7ff534004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 --2- 172.21.15.164:0/3811995758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff534004c20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff54c15a7b0 tx=0x7ff53801d2d0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552200640 1 -- 172.21.15.164:0/3811995758 reap_dead start 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 -- 172.21.15.164:0/3811995758 shutdown_connections 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 -- 172.21.15.164:0/3811995758 >> 172.21.15.164:0/3811995758 conn(0x7ff54c070da0 msgr2=0x7ff54c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 -- 172.21.15.164:0/3811995758 shutdown_connections 2024-08-31T12:14:27.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.132+0000 7ff552c00640 1 -- 172.21.15.164:0/3811995758 wait complete. 2024-08-31T12:14:27.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 Processor -- start 2024-08-31T12:14:27.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- start start 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 0x7ff54c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff54c154c80 0x7ff54c14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c0c7a10 con 0x7ff534004810 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c071fc0 con 0x7ff54c151ab0 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff54c0c7b90 con 0x7ff54c154c80 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38616/0 (socket says 172.21.15.164:38616) 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 -- 172.21.15.164:0/754229343 learned_addr learned my addr 172.21.15.164:0/754229343 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff550e00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 0x7ff54c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552200640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff54c154c80 0x7ff54c14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 -- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff54c154c80 msgr2=0x7ff54c14ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff54c154c80 0x7ff54c14ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 -- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 msgr2=0x7ff54c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 0x7ff54c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 -- 172.21.15.164:0/754229343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c15c6f0 con 0x7ff534004810 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff550e00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 0x7ff54c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff551800640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff540004dd0 tx=0x7ff5400017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540010890 con 0x7ff534004810 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff540010b40 con 0x7ff534004810 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c14c600 con 0x7ff534004810 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540011460 con 0x7ff534004810 2024-08-31T12:14:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.136+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c15b9b0 con 0x7ff534004810 2024-08-31T12:14:27.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff54c06d7c0 con 0x7ff534004810 2024-08-31T12:14:27.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff540011600 con 0x7ff534004810 2024-08-31T12:14:27.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff549600640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 0x7ff52c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7ff540093920 con 0x7ff534004810 2024-08-31T12:14:27.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff550e00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 0x7ff52c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.140+0000 7ff550e00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 0x7ff52c0745d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5380ae000 tx=0x7ff53801a070 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.144+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff54005eef0 con 0x7ff534004810 2024-08-31T12:14:27.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.316+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff54c150e10 con 0x7ff52c0720c0 2024-08-31T12:14:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.332+0000 7ff549600640 1 -- 172.21.15.164:0/754229343 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7ff54c150e10 con 0x7ff52c0720c0 2024-08-31T12:14:27.338 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:27.340 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:27.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 msgr2=0x7ff52c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 0x7ff52c0745d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5380ae000 tx=0x7ff53801a070 comp rx=0 tx=0).stop 2024-08-31T12:14:27.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 msgr2=0x7ff54c15c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff540004dd0 tx=0x7ff5400017b0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 shutdown_connections 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff52c0720c0 0x7ff52c0745d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff54c154c80 0x7ff54c14ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c151ab0 0x7ff54c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 --2- 172.21.15.164:0/754229343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff534004810 0x7ff54c15c1b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 >> 172.21.15.164:0/754229343 conn(0x7ff54c070da0 msgr2=0x7ff54c152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 shutdown_connections 2024-08-31T12:14:27.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.336+0000 7ff552c00640 1 -- 172.21.15.164:0/754229343 wait complete. 2024-08-31T12:14:27.361 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-08-31T12:14:26.612085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595267,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":151,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":259,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.070480"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:23.949922+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:23.949922+0000","last_peered":"2024-08-31T12:14:23.949922+0000","last_clean":"2024-08-31T12:14:23.949922+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:23.949922+0000","last_undegraded":"2024-08-31T12:14:23.949922+0000","last_fullsized":"2024-08-31T12:14:23.949922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4101,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4899,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:27.366 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-08-31T12:14:27.367 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:14:27.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 -- 172.21.15.164:0/124001912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 msgr2=0x7f25fc0c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 --2- 172.21.15.164:0/124001912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc0c3e80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009840 tx=0x7f25e401f010 comp rx=0 tx=0).stop 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 -- 172.21.15.164:0/124001912 shutdown_connections 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 --2- 172.21.15.164:0/124001912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc0c3e80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 --2- 172.21.15.164:0/124001912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 0x7f25fc0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 -- 172.21.15.164:0/124001912 >> 172.21.15.164:0/124001912 conn(0x7f25fc0cca80 msgr2=0x7f25fc0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 -- 172.21.15.164:0/124001912 shutdown_connections 2024-08-31T12:14:27.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.552+0000 7f2600e00640 1 -- 172.21.15.164:0/124001912 wait complete. 2024-08-31T12:14:27.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 Processor -- start 2024-08-31T12:14:27.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- start start 2024-08-31T12:14:27.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25fc074ed0 0x7f25fc1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 0x7f25fc1e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc0c4950 con 0x7f25fc158fd0 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc074bb0 con 0x7f25fc074ed0 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25fc0c4c30 con 0x7f25fc0c6620 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38632/0 (socket says 172.21.15.164:38632) 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 -- 172.21.15.164:0/3784713464 learned_addr learned my addr 172.21.15.164:0/3784713464 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25f2a00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 0x7f25fc1e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fb400640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25fc074ed0 0x7f25fc1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 -- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 msgr2=0x7f25fc1e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 0x7f25fc1e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 -- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25fc074ed0 msgr2=0x7f25fc1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25fc074ed0 0x7f25fc1530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 -- 172.21.15.164:0/3784713464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc14de40 con 0x7f25fc158fd0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25fbe00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f25f400ea80 tx=0x7f25f400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f400cea0 con 0x7f25fc158fd0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25f4004b30 con 0x7f25fc158fd0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc14e0b0 con 0x7f25fc158fd0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4005020 con 0x7f25fc158fd0 2024-08-31T12:14:27.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.556+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc0cbd10 con 0x7f25fc158fd0 2024-08-31T12:14:27.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.560+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc14c430 con 0x7f25fc158fd0 2024-08-31T12:14:27.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.560+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f25f40051c0 con 0x7f25fc158fd0 2024-08-31T12:14:27.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.560+0000 7f25f3e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 0x7f25d8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.560+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f25f4093a10 con 0x7f25fc158fd0 2024-08-31T12:14:27.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.560+0000 7f25fb400640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 0x7f25d8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.564+0000 7f25fb400640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 0x7f25d8074600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25ec007fd0 tx=0x7f25ec009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.564+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f25f405e910 con 0x7f25fc158fd0 2024-08-31T12:14:27.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.736+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25fc1583d0 con 0x7f25d80720f0 2024-08-31T12:14:27.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.752+0000 7f25f3e00640 1 -- 172.21.15.164:0/3784713464 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332521 (secure 0 0 0) 0x7f25fc1583d0 con 0x7f25d80720f0 2024-08-31T12:14:27.761 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 msgr2=0x7f25d8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 0x7f25d8074600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25ec007fd0 tx=0x7f25ec009040 comp rx=0 tx=0).stop 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 msgr2=0x7f25fc156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f25f400ea80 tx=0x7f25f400ef40 comp rx=0 tx=0).stop 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 shutdown_connections 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f25d80720f0 0x7f25d8074600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25fc158fd0 0x7f25fc156c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25fc0c6620 0x7f25fc1e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 --2- 172.21.15.164:0/3784713464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25fc074ed0 0x7f25fc1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 >> 172.21.15.164:0/3784713464 conn(0x7f25fc0cca80 msgr2=0x7f25fc155740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 shutdown_connections 2024-08-31T12:14:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.756+0000 7f2600e00640 1 -- 172.21.15.164:0/3784713464 wait complete. 2024-08-31T12:14:27.782 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-08-31T12:14:27.625358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595267,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":151,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":259,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.082434"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720371+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:13:51.720371+0000","last_peered":"2024-08-31T12:13:51.720371+0000","last_clean":"2024-08-31T12:13:51.720371+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:13:51.720371+0000","last_undegraded":"2024-08-31T12:13:51.720371+0000","last_fullsized":"2024-08-31T12:13:51.720371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403064+0000","last_change":"2024-08-31T12:13:46.704002+0000","last_active":"2024-08-31T12:13:52.403064+0000","last_peered":"2024-08-31T12:13:52.403064+0000","last_clean":"2024-08-31T12:13:52.403064+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:13:52.403064+0000","last_undegraded":"2024-08-31T12:13:52.403064+0000","last_fullsized":"2024-08-31T12:13:52.403064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:15:49.982214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717897+0000","last_change":"2024-08-31T12:13:50.754832+0000","last_active":"2024-08-31T12:13:51.717897+0000","last_peered":"2024-08-31T12:13:51.717897+0000","last_clean":"2024-08-31T12:13:51.717897+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:13:51.717897+0000","last_undegraded":"2024-08-31T12:13:51.717897+0000","last_fullsized":"2024-08-31T12:13:51.717897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:03.196477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403295+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:13:52.403295+0000","last_peered":"2024-08-31T12:13:52.403295+0000","last_clean":"2024-08-31T12:13:52.403295+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:13:52.403295+0000","last_undegraded":"2024-08-31T12:13:52.403295+0000","last_fullsized":"2024-08-31T12:13:52.403295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403186+0000","last_change":"2024-08-31T12:13:46.706348+0000","last_active":"2024-08-31T12:13:52.403186+0000","last_peered":"2024-08-31T12:13:52.403186+0000","last_clean":"2024-08-31T12:13:52.403186+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:13:52.403186+0000","last_undegraded":"2024-08-31T12:13:52.403186+0000","last_fullsized":"2024-08-31T12:13:52.403186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:23:29.627705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711605+0000","last_change":"2024-08-31T12:13:50.753682+0000","last_active":"2024-08-31T12:13:51.711605+0000","last_peered":"2024-08-31T12:13:51.711605+0000","last_clean":"2024-08-31T12:13:51.711605+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:13:51.711605+0000","last_undegraded":"2024-08-31T12:13:51.711605+0000","last_fullsized":"2024-08-31T12:13:51.711605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:03.411736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397126+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:13:52.397126+0000","last_peered":"2024-08-31T12:13:52.397126+0000","last_clean":"2024-08-31T12:13:52.397126+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:13:52.397126+0000","last_undegraded":"2024-08-31T12:13:52.397126+0000","last_fullsized":"2024-08-31T12:13:52.397126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703524+0000","last_change":"2024-08-31T12:13:46.660776+0000","last_active":"2024-08-31T12:13:51.703524+0000","last_peered":"2024-08-31T12:13:51.703524+0000","last_clean":"2024-08-31T12:13:51.703524+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:13:51.703524+0000","last_undegraded":"2024-08-31T12:13:51.703524+0000","last_fullsized":"2024-08-31T12:13:51.703524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:50.769398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711973+0000","last_change":"2024-08-31T12:13:50.732792+0000","last_active":"2024-08-31T12:13:51.711973+0000","last_peered":"2024-08-31T12:13:51.711973+0000","last_clean":"2024-08-31T12:13:51.711973+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:13:51.711973+0000","last_undegraded":"2024-08-31T12:13:51.711973+0000","last_fullsized":"2024-08-31T12:13:51.711973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:09:16.940680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397260+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:13:52.397260+0000","last_peered":"2024-08-31T12:13:52.397260+0000","last_clean":"2024-08-31T12:13:52.397260+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:13:52.397260+0000","last_undegraded":"2024-08-31T12:13:52.397260+0000","last_fullsized":"2024-08-31T12:13:52.397260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708482+0000","last_change":"2024-08-31T12:13:46.684274+0000","last_active":"2024-08-31T12:13:51.708482+0000","last_peered":"2024-08-31T12:13:51.708482+0000","last_clean":"2024-08-31T12:13:51.708482+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:13:51.708482+0000","last_undegraded":"2024-08-31T12:13:51.708482+0000","last_fullsized":"2024-08-31T12:13:51.708482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:56:08.518273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711730+0000","last_change":"2024-08-31T12:13:50.755555+0000","last_active":"2024-08-31T12:13:51.711730+0000","last_peered":"2024-08-31T12:13:51.711730+0000","last_clean":"2024-08-31T12:13:51.711730+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:13:51.711730+0000","last_undegraded":"2024-08-31T12:13:51.711730+0000","last_fullsized":"2024-08-31T12:13:51.711730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:21.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707382+0000","last_change":"2024-08-31T12:13:46.675601+0000","last_active":"2024-08-31T12:13:51.707382+0000","last_peered":"2024-08-31T12:13:51.707382+0000","last_clean":"2024-08-31T12:13:51.707382+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:13:51.707382+0000","last_undegraded":"2024-08-31T12:13:51.707382+0000","last_fullsized":"2024-08-31T12:13:51.707382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:03.585644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707564+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:13:51.707564+0000","last_peered":"2024-08-31T12:13:51.707564+0000","last_clean":"2024-08-31T12:13:51.707564+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:13:51.707564+0000","last_undegraded":"2024-08-31T12:13:51.707564+0000","last_fullsized":"2024-08-31T12:13:51.707564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708281+0000","last_change":"2024-08-31T12:13:50.753717+0000","last_active":"2024-08-31T12:13:51.708281+0000","last_peered":"2024-08-31T12:13:51.708281+0000","last_clean":"2024-08-31T12:13:51.708281+0000","last_became_active":"2024-08-31T12:13:50.753293+0000","last_became_peered":"2024-08-31T12:13:50.753293+0000","last_unstale":"2024-08-31T12:13:51.708281+0000","last_undegraded":"2024-08-31T12:13:51.708281+0000","last_fullsized":"2024-08-31T12:13:51.708281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.443005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720783+0000","last_change":"2024-08-31T12:13:46.699681+0000","last_active":"2024-08-31T12:13:51.720783+0000","last_peered":"2024-08-31T12:13:51.720783+0000","last_clean":"2024-08-31T12:13:51.720783+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:13:51.720783+0000","last_undegraded":"2024-08-31T12:13:51.720783+0000","last_fullsized":"2024-08-31T12:13:51.720783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:34.650618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399861+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:13:52.399861+0000","last_peered":"2024-08-31T12:13:52.399861+0000","last_clean":"2024-08-31T12:13:52.399861+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:13:52.399861+0000","last_undegraded":"2024-08-31T12:13:52.399861+0000","last_fullsized":"2024-08-31T12:13:52.399861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396775+0000","last_change":"2024-08-31T12:13:50.738763+0000","last_active":"2024-08-31T12:13:52.396775+0000","last_peered":"2024-08-31T12:13:52.396775+0000","last_clean":"2024-08-31T12:13:52.396775+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:13:52.396775+0000","last_undegraded":"2024-08-31T12:13:52.396775+0000","last_fullsized":"2024-08-31T12:13:52.396775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:58:58.114574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716515+0000","last_change":"2024-08-31T12:13:46.698229+0000","last_active":"2024-08-31T12:13:51.716515+0000","last_peered":"2024-08-31T12:13:51.716515+0000","last_clean":"2024-08-31T12:13:51.716515+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:13:51.716515+0000","last_undegraded":"2024-08-31T12:13:51.716515+0000","last_fullsized":"2024-08-31T12:13:51.716515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:21.770467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718058+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:13:51.718058+0000","last_peered":"2024-08-31T12:13:51.718058+0000","last_clean":"2024-08-31T12:13:51.718058+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:13:51.718058+0000","last_undegraded":"2024-08-31T12:13:51.718058+0000","last_fullsized":"2024-08-31T12:13:51.718058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721592+0000","last_change":"2024-08-31T12:13:50.755911+0000","last_active":"2024-08-31T12:13:51.721592+0000","last_peered":"2024-08-31T12:13:51.721592+0000","last_clean":"2024-08-31T12:13:51.721592+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:13:51.721592+0000","last_undegraded":"2024-08-31T12:13:51.721592+0000","last_fullsized":"2024-08-31T12:13:51.721592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:29:36.020041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707203+0000","last_change":"2024-08-31T12:13:46.688303+0000","last_active":"2024-08-31T12:13:51.707203+0000","last_peered":"2024-08-31T12:13:51.707203+0000","last_clean":"2024-08-31T12:13:51.707203+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:13:51.707203+0000","last_undegraded":"2024-08-31T12:13:51.707203+0000","last_fullsized":"2024-08-31T12:13:51.707203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:06.930395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396367+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:13:52.396367+0000","last_peered":"2024-08-31T12:13:52.396367+0000","last_clean":"2024-08-31T12:13:52.396367+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:13:52.396367+0000","last_undegraded":"2024-08-31T12:13:52.396367+0000","last_fullsized":"2024-08-31T12:13:52.396367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712373+0000","last_change":"2024-08-31T12:13:50.756473+0000","last_active":"2024-08-31T12:13:51.712373+0000","last_peered":"2024-08-31T12:13:51.712373+0000","last_clean":"2024-08-31T12:13:51.712373+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:13:51.712373+0000","last_undegraded":"2024-08-31T12:13:51.712373+0000","last_fullsized":"2024-08-31T12:13:51.712373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:09:04.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718432+0000","last_change":"2024-08-31T12:13:46.708765+0000","last_active":"2024-08-31T12:13:51.718432+0000","last_peered":"2024-08-31T12:13:51.718432+0000","last_clean":"2024-08-31T12:13:51.718432+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:13:51.718432+0000","last_undegraded":"2024-08-31T12:13:51.718432+0000","last_fullsized":"2024-08-31T12:13:51.718432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:48.017299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708869+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:13:51.708869+0000","last_peered":"2024-08-31T12:13:51.708869+0000","last_clean":"2024-08-31T12:13:51.708869+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:13:51.708869+0000","last_undegraded":"2024-08-31T12:13:51.708869+0000","last_fullsized":"2024-08-31T12:13:51.708869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711786+0000","last_change":"2024-08-31T12:13:50.732231+0000","last_active":"2024-08-31T12:13:51.711786+0000","last_peered":"2024-08-31T12:13:51.711786+0000","last_clean":"2024-08-31T12:13:51.711786+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:13:51.711786+0000","last_undegraded":"2024-08-31T12:13:51.711786+0000","last_fullsized":"2024-08-31T12:13:51.711786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:24:40.082344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720662+0000","last_change":"2024-08-31T12:13:46.699485+0000","last_active":"2024-08-31T12:13:51.720662+0000","last_peered":"2024-08-31T12:13:51.720662+0000","last_clean":"2024-08-31T12:13:51.720662+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:13:51.720662+0000","last_undegraded":"2024-08-31T12:13:51.720662+0000","last_fullsized":"2024-08-31T12:13:51.720662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:53.209355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719888+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:13:51.719888+0000","last_peered":"2024-08-31T12:13:51.719888+0000","last_clean":"2024-08-31T12:13:51.719888+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:13:51.719888+0000","last_undegraded":"2024-08-31T12:13:51.719888+0000","last_fullsized":"2024-08-31T12:13:51.719888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716925+0000","last_change":"2024-08-31T12:13:50.741899+0000","last_active":"2024-08-31T12:13:51.716925+0000","last_peered":"2024-08-31T12:13:51.716925+0000","last_clean":"2024-08-31T12:13:51.716925+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:13:51.716925+0000","last_undegraded":"2024-08-31T12:13:51.716925+0000","last_fullsized":"2024-08-31T12:13:51.716925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:21:07.364069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401310+0000","last_change":"2024-08-31T12:13:46.706692+0000","last_active":"2024-08-31T12:13:52.401310+0000","last_peered":"2024-08-31T12:13:52.401310+0000","last_clean":"2024-08-31T12:13:52.401310+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:13:52.401310+0000","last_undegraded":"2024-08-31T12:13:52.401310+0000","last_fullsized":"2024-08-31T12:13:52.401310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:01:09.658881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708848+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:13:51.708848+0000","last_peered":"2024-08-31T12:13:51.708848+0000","last_clean":"2024-08-31T12:13:51.708848+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:13:51.708848+0000","last_undegraded":"2024-08-31T12:13:51.708848+0000","last_fullsized":"2024-08-31T12:13:51.708848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400443+0000","last_change":"2024-08-31T12:13:50.756152+0000","last_active":"2024-08-31T12:13:52.400443+0000","last_peered":"2024-08-31T12:13:52.400443+0000","last_clean":"2024-08-31T12:13:52.400443+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:13:52.400443+0000","last_undegraded":"2024-08-31T12:13:52.400443+0000","last_fullsized":"2024-08-31T12:13:52.400443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:28:56.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712116+0000","last_change":"2024-08-31T12:13:46.663692+0000","last_active":"2024-08-31T12:13:51.712116+0000","last_peered":"2024-08-31T12:13:51.712116+0000","last_clean":"2024-08-31T12:13:51.712116+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:13:51.712116+0000","last_undegraded":"2024-08-31T12:13:51.712116+0000","last_fullsized":"2024-08-31T12:13:51.712116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:05:31.490228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401864+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:13:52.401864+0000","last_peered":"2024-08-31T12:13:52.401864+0000","last_clean":"2024-08-31T12:13:52.401864+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:13:52.401864+0000","last_undegraded":"2024-08-31T12:13:52.401864+0000","last_fullsized":"2024-08-31T12:13:52.401864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399301+0000","last_change":"2024-08-31T12:13:50.769053+0000","last_active":"2024-08-31T12:13:52.399301+0000","last_peered":"2024-08-31T12:13:52.399301+0000","last_clean":"2024-08-31T12:13:52.399301+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:13:52.399301+0000","last_undegraded":"2024-08-31T12:13:52.399301+0000","last_fullsized":"2024-08-31T12:13:52.399301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:09.990665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396679+0000","last_change":"2024-08-31T12:13:46.662108+0000","last_active":"2024-08-31T12:13:52.396679+0000","last_peered":"2024-08-31T12:13:52.396679+0000","last_clean":"2024-08-31T12:13:52.396679+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:13:52.396679+0000","last_undegraded":"2024-08-31T12:13:52.396679+0000","last_fullsized":"2024-08-31T12:13:52.396679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:15.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707653+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:13:51.707653+0000","last_peered":"2024-08-31T12:13:51.707653+0000","last_clean":"2024-08-31T12:13:51.707653+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:13:51.707653+0000","last_undegraded":"2024-08-31T12:13:51.707653+0000","last_fullsized":"2024-08-31T12:13:51.707653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400781+0000","last_change":"2024-08-31T12:13:50.758958+0000","last_active":"2024-08-31T12:13:52.400781+0000","last_peered":"2024-08-31T12:13:52.400781+0000","last_clean":"2024-08-31T12:13:52.400781+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:13:52.400781+0000","last_undegraded":"2024-08-31T12:13:52.400781+0000","last_fullsized":"2024-08-31T12:13:52.400781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:45:40.271091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399280+0000","last_change":"2024-08-31T12:13:46.710656+0000","last_active":"2024-08-31T12:13:52.399280+0000","last_peered":"2024-08-31T12:13:52.399280+0000","last_clean":"2024-08-31T12:13:52.399280+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:13:52.399280+0000","last_undegraded":"2024-08-31T12:13:52.399280+0000","last_fullsized":"2024-08-31T12:13:52.399280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:23.413587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718684+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:13:51.718684+0000","last_peered":"2024-08-31T12:13:51.718684+0000","last_clean":"2024-08-31T12:13:51.718684+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:13:51.718684+0000","last_undegraded":"2024-08-31T12:13:51.718684+0000","last_fullsized":"2024-08-31T12:13:51.718684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402398+0000","last_change":"2024-08-31T12:13:50.769420+0000","last_active":"2024-08-31T12:13:52.402398+0000","last_peered":"2024-08-31T12:13:52.402398+0000","last_clean":"2024-08-31T12:13:52.402398+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:13:52.402398+0000","last_undegraded":"2024-08-31T12:13:52.402398+0000","last_fullsized":"2024-08-31T12:13:52.402398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:47:22.274686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399153+0000","last_change":"2024-08-31T12:13:46.666344+0000","last_active":"2024-08-31T12:13:52.399153+0000","last_peered":"2024-08-31T12:13:52.399153+0000","last_clean":"2024-08-31T12:13:52.399153+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:13:52.399153+0000","last_undegraded":"2024-08-31T12:13:52.399153+0000","last_fullsized":"2024-08-31T12:13:52.399153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:28.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707530+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:13:51.707530+0000","last_peered":"2024-08-31T12:13:51.707530+0000","last_clean":"2024-08-31T12:13:51.707530+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:13:51.707530+0000","last_undegraded":"2024-08-31T12:13:51.707530+0000","last_fullsized":"2024-08-31T12:13:51.707530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402561+0000","last_change":"2024-08-31T12:13:50.766977+0000","last_active":"2024-08-31T12:13:52.402561+0000","last_peered":"2024-08-31T12:13:52.402561+0000","last_clean":"2024-08-31T12:13:52.402561+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:13:52.402561+0000","last_undegraded":"2024-08-31T12:13:52.402561+0000","last_fullsized":"2024-08-31T12:13:52.402561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:53.229878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719107+0000","last_change":"2024-08-31T12:13:46.691119+0000","last_active":"2024-08-31T12:13:51.719107+0000","last_peered":"2024-08-31T12:13:51.719107+0000","last_clean":"2024-08-31T12:13:51.719107+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:13:51.719107+0000","last_undegraded":"2024-08-31T12:13:51.719107+0000","last_fullsized":"2024-08-31T12:13:51.719107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:14.570302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707574+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:13:51.707574+0000","last_peered":"2024-08-31T12:13:51.707574+0000","last_clean":"2024-08-31T12:13:51.707574+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:13:51.707574+0000","last_undegraded":"2024-08-31T12:13:51.707574+0000","last_fullsized":"2024-08-31T12:13:51.707574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703192+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:13:51.703192+0000","last_peered":"2024-08-31T12:13:51.703192+0000","last_clean":"2024-08-31T12:13:51.703192+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:13:51.703192+0000","last_undegraded":"2024-08-31T12:13:51.703192+0000","last_fullsized":"2024-08-31T12:13:51.703192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708717+0000","last_change":"2024-08-31T12:13:50.721792+0000","last_active":"2024-08-31T12:13:51.708717+0000","last_peered":"2024-08-31T12:13:51.708717+0000","last_clean":"2024-08-31T12:13:51.708717+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:13:51.708717+0000","last_undegraded":"2024-08-31T12:13:51.708717+0000","last_fullsized":"2024-08-31T12:13:51.708717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:41:36.965145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708630+0000","last_change":"2024-08-31T12:13:46.682367+0000","last_active":"2024-08-31T12:13:51.708630+0000","last_peered":"2024-08-31T12:13:51.708630+0000","last_clean":"2024-08-31T12:13:51.708630+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:13:51.708630+0000","last_undegraded":"2024-08-31T12:13:51.708630+0000","last_fullsized":"2024-08-31T12:13:51.708630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:20.045244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401579+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:13:52.401579+0000","last_peered":"2024-08-31T12:13:52.401579+0000","last_clean":"2024-08-31T12:13:52.401579+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:13:52.401579+0000","last_undegraded":"2024-08-31T12:13:52.401579+0000","last_fullsized":"2024-08-31T12:13:52.401579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711869+0000","last_change":"2024-08-31T12:13:50.751390+0000","last_active":"2024-08-31T12:13:51.711869+0000","last_peered":"2024-08-31T12:13:51.711869+0000","last_clean":"2024-08-31T12:13:51.711869+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:13:51.711869+0000","last_undegraded":"2024-08-31T12:13:51.711869+0000","last_fullsized":"2024-08-31T12:13:51.711869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:40.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397059+0000","last_change":"2024-08-31T12:13:46.677481+0000","last_active":"2024-08-31T12:13:52.397059+0000","last_peered":"2024-08-31T12:13:52.397059+0000","last_clean":"2024-08-31T12:13:52.397059+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:13:52.397059+0000","last_undegraded":"2024-08-31T12:13:52.397059+0000","last_fullsized":"2024-08-31T12:13:52.397059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:18:30.487530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402981+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:13:52.402981+0000","last_peered":"2024-08-31T12:13:52.402981+0000","last_clean":"2024-08-31T12:13:52.402981+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:13:52.402981+0000","last_undegraded":"2024-08-31T12:13:52.402981+0000","last_fullsized":"2024-08-31T12:13:52.402981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400549+0000","last_change":"2024-08-31T12:13:50.736988+0000","last_active":"2024-08-31T12:13:52.400549+0000","last_peered":"2024-08-31T12:13:52.400549+0000","last_clean":"2024-08-31T12:13:52.400549+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:13:52.400549+0000","last_undegraded":"2024-08-31T12:13:52.400549+0000","last_fullsized":"2024-08-31T12:13:52.400549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:30.735857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397244+0000","last_change":"2024-08-31T12:13:46.661980+0000","last_active":"2024-08-31T12:13:52.397244+0000","last_peered":"2024-08-31T12:13:52.397244+0000","last_clean":"2024-08-31T12:13:52.397244+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:13:52.397244+0000","last_undegraded":"2024-08-31T12:13:52.397244+0000","last_fullsized":"2024-08-31T12:13:52.397244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:54:30.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720159+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:13:51.720159+0000","last_peered":"2024-08-31T12:13:51.720159+0000","last_clean":"2024-08-31T12:13:51.720159+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:13:51.720159+0000","last_undegraded":"2024-08-31T12:13:51.720159+0000","last_fullsized":"2024-08-31T12:13:51.720159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.706965+0000","last_change":"2024-08-31T12:13:50.743624+0000","last_active":"2024-08-31T12:13:51.706965+0000","last_peered":"2024-08-31T12:13:51.706965+0000","last_clean":"2024-08-31T12:13:51.706965+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:13:51.706965+0000","last_undegraded":"2024-08-31T12:13:51.706965+0000","last_fullsized":"2024-08-31T12:13:51.706965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:36.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712649+0000","last_change":"2024-08-31T12:13:46.662863+0000","last_active":"2024-08-31T12:13:51.712649+0000","last_peered":"2024-08-31T12:13:51.712649+0000","last_clean":"2024-08-31T12:13:51.712649+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:13:51.712649+0000","last_undegraded":"2024-08-31T12:13:51.712649+0000","last_fullsized":"2024-08-31T12:13:51.712649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:27.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397262+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:13:52.397262+0000","last_peered":"2024-08-31T12:13:52.397262+0000","last_clean":"2024-08-31T12:13:52.397262+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:13:52.397262+0000","last_undegraded":"2024-08-31T12:13:52.397262+0000","last_fullsized":"2024-08-31T12:13:52.397262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703401+0000","last_change":"2024-08-31T12:13:50.742846+0000","last_active":"2024-08-31T12:13:51.703401+0000","last_peered":"2024-08-31T12:13:51.703401+0000","last_clean":"2024-08-31T12:13:51.703401+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:13:51.703401+0000","last_undegraded":"2024-08-31T12:13:51.703401+0000","last_fullsized":"2024-08-31T12:13:51.703401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:52:53.695348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707126+0000","last_change":"2024-08-31T12:13:46.680942+0000","last_active":"2024-08-31T12:13:51.707126+0000","last_peered":"2024-08-31T12:13:51.707126+0000","last_clean":"2024-08-31T12:13:51.707126+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:13:51.707126+0000","last_undegraded":"2024-08-31T12:13:51.707126+0000","last_fullsized":"2024-08-31T12:13:51.707126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:36.304804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.716839+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:13:51.716839+0000","last_peered":"2024-08-31T12:13:51.716839+0000","last_clean":"2024-08-31T12:13:51.716839+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:13:51.716839+0000","last_undegraded":"2024-08-31T12:13:51.716839+0000","last_fullsized":"2024-08-31T12:13:51.716839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402965+0000","last_change":"2024-08-31T12:13:50.755507+0000","last_active":"2024-08-31T12:13:52.402965+0000","last_peered":"2024-08-31T12:13:52.402965+0000","last_clean":"2024-08-31T12:13:52.402965+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:13:52.402965+0000","last_undegraded":"2024-08-31T12:13:52.402965+0000","last_fullsized":"2024-08-31T12:13:52.402965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:50.858779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.702982+0000","last_change":"2024-08-31T12:13:46.704984+0000","last_active":"2024-08-31T12:13:51.702982+0000","last_peered":"2024-08-31T12:13:51.702982+0000","last_clean":"2024-08-31T12:13:51.702982+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:13:51.702982+0000","last_undegraded":"2024-08-31T12:13:51.702982+0000","last_fullsized":"2024-08-31T12:13:51.702982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:16.881619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396647+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:13:52.396647+0000","last_peered":"2024-08-31T12:13:52.396647+0000","last_clean":"2024-08-31T12:13:52.396647+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:13:52.396647+0000","last_undegraded":"2024-08-31T12:13:52.396647+0000","last_fullsized":"2024-08-31T12:13:52.396647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403287+0000","last_change":"2024-08-31T12:13:50.743951+0000","last_active":"2024-08-31T12:13:52.403287+0000","last_peered":"2024-08-31T12:13:52.403287+0000","last_clean":"2024-08-31T12:13:52.403287+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:13:52.403287+0000","last_undegraded":"2024-08-31T12:13:52.403287+0000","last_fullsized":"2024-08-31T12:13:52.403287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:48:32.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707361+0000","last_change":"2024-08-31T12:13:46.676539+0000","last_active":"2024-08-31T12:13:51.707361+0000","last_peered":"2024-08-31T12:13:51.707361+0000","last_clean":"2024-08-31T12:13:51.707361+0000","last_became_active":"2024-08-31T12:13:46.676289+0000","last_became_peered":"2024-08-31T12:13:46.676289+0000","last_unstale":"2024-08-31T12:13:51.707361+0000","last_undegraded":"2024-08-31T12:13:51.707361+0000","last_fullsized":"2024-08-31T12:13:51.707361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:56:06.030892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707548+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:13:51.707548+0000","last_peered":"2024-08-31T12:13:51.707548+0000","last_clean":"2024-08-31T12:13:51.707548+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:13:51.707548+0000","last_undegraded":"2024-08-31T12:13:51.707548+0000","last_fullsized":"2024-08-31T12:13:51.707548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400034+0000","last_change":"2024-08-31T12:13:50.771198+0000","last_active":"2024-08-31T12:13:52.400034+0000","last_peered":"2024-08-31T12:13:52.400034+0000","last_clean":"2024-08-31T12:13:52.400034+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:13:52.400034+0000","last_undegraded":"2024-08-31T12:13:52.400034+0000","last_fullsized":"2024-08-31T12:13:52.400034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:07:17.390078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399555+0000","last_change":"2024-08-31T12:13:46.686723+0000","last_active":"2024-08-31T12:13:52.399555+0000","last_peered":"2024-08-31T12:13:52.399555+0000","last_clean":"2024-08-31T12:13:52.399555+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:13:52.399555+0000","last_undegraded":"2024-08-31T12:13:52.399555+0000","last_fullsized":"2024-08-31T12:13:52.399555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:59.438721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721401+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:13:51.721401+0000","last_peered":"2024-08-31T12:13:51.721401+0000","last_clean":"2024-08-31T12:13:51.721401+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:13:51.721401+0000","last_undegraded":"2024-08-31T12:13:51.721401+0000","last_fullsized":"2024-08-31T12:13:51.721401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708397+0000","last_change":"2024-08-31T12:13:50.731750+0000","last_active":"2024-08-31T12:13:51.708397+0000","last_peered":"2024-08-31T12:13:51.708397+0000","last_clean":"2024-08-31T12:13:51.708397+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:13:51.708397+0000","last_undegraded":"2024-08-31T12:13:51.708397+0000","last_fullsized":"2024-08-31T12:13:51.708397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:10:01.080857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397018+0000","last_change":"2024-08-31T12:13:46.667690+0000","last_active":"2024-08-31T12:13:52.397018+0000","last_peered":"2024-08-31T12:13:52.397018+0000","last_clean":"2024-08-31T12:13:52.397018+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:13:52.397018+0000","last_undegraded":"2024-08-31T12:13:52.397018+0000","last_fullsized":"2024-08-31T12:13:52.397018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.831751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:14:23.949922+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:14:23.949922+0000","last_peered":"2024-08-31T12:14:23.949922+0000","last_clean":"2024-08-31T12:14:23.949922+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:14:23.949922+0000","last_undegraded":"2024-08-31T12:14:23.949922+0000","last_fullsized":"2024-08-31T12:14:23.949922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4101,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.719039+0000","last_change":"2024-08-31T12:13:50.735782+0000","last_active":"2024-08-31T12:13:51.719039+0000","last_peered":"2024-08-31T12:13:51.719039+0000","last_clean":"2024-08-31T12:13:51.719039+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:13:51.719039+0000","last_undegraded":"2024-08-31T12:13:51.719039+0000","last_fullsized":"2024-08-31T12:13:51.719039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:08:08.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707320+0000","last_change":"2024-08-31T12:13:46.678448+0000","last_active":"2024-08-31T12:13:51.707320+0000","last_peered":"2024-08-31T12:13:51.707320+0000","last_clean":"2024-08-31T12:13:51.707320+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:13:51.707320+0000","last_undegraded":"2024-08-31T12:13:51.707320+0000","last_fullsized":"2024-08-31T12:13:51.707320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:06:40.540024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721503+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:13:51.721503+0000","last_peered":"2024-08-31T12:13:51.721503+0000","last_clean":"2024-08-31T12:13:51.721503+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:13:51.721503+0000","last_undegraded":"2024-08-31T12:13:51.721503+0000","last_fullsized":"2024-08-31T12:13:51.721503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711957+0000","last_change":"2024-08-31T12:13:50.752929+0000","last_active":"2024-08-31T12:13:51.711957+0000","last_peered":"2024-08-31T12:13:51.711957+0000","last_clean":"2024-08-31T12:13:51.711957+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:13:51.711957+0000","last_undegraded":"2024-08-31T12:13:51.711957+0000","last_fullsized":"2024-08-31T12:13:51.711957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:38.215681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.403486+0000","last_change":"2024-08-31T12:13:46.705359+0000","last_active":"2024-08-31T12:13:52.403486+0000","last_peered":"2024-08-31T12:13:52.403486+0000","last_clean":"2024-08-31T12:13:52.403486+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:13:52.403486+0000","last_undegraded":"2024-08-31T12:13:52.403486+0000","last_fullsized":"2024-08-31T12:13:52.403486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:24.622763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397132+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:13:52.397132+0000","last_peered":"2024-08-31T12:13:52.397132+0000","last_clean":"2024-08-31T12:13:52.397132+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:13:52.397132+0000","last_undegraded":"2024-08-31T12:13:52.397132+0000","last_fullsized":"2024-08-31T12:13:52.397132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717490+0000","last_change":"2024-08-31T12:13:50.752347+0000","last_active":"2024-08-31T12:13:51.717490+0000","last_peered":"2024-08-31T12:13:51.717490+0000","last_clean":"2024-08-31T12:13:51.717490+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:13:51.717490+0000","last_undegraded":"2024-08-31T12:13:51.717490+0000","last_fullsized":"2024-08-31T12:13:51.717490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:36:51.439006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712580+0000","last_change":"2024-08-31T12:13:46.676771+0000","last_active":"2024-08-31T12:13:51.712580+0000","last_peered":"2024-08-31T12:13:51.712580+0000","last_clean":"2024-08-31T12:13:51.712580+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:13:51.712580+0000","last_undegraded":"2024-08-31T12:13:51.712580+0000","last_fullsized":"2024-08-31T12:13:51.712580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:32:32.162072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704345+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:13:51.704345+0000","last_peered":"2024-08-31T12:13:51.704345+0000","last_clean":"2024-08-31T12:13:51.704345+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:13:51.704345+0000","last_undegraded":"2024-08-31T12:13:51.704345+0000","last_fullsized":"2024-08-31T12:13:51.704345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718069+0000","last_change":"2024-08-31T12:13:50.761914+0000","last_active":"2024-08-31T12:13:51.718069+0000","last_peered":"2024-08-31T12:13:51.718069+0000","last_clean":"2024-08-31T12:13:51.718069+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:13:51.718069+0000","last_undegraded":"2024-08-31T12:13:51.718069+0000","last_fullsized":"2024-08-31T12:13:51.718069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:20.594871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718986+0000","last_change":"2024-08-31T12:13:50.739202+0000","last_active":"2024-08-31T12:13:51.718986+0000","last_peered":"2024-08-31T12:13:51.718986+0000","last_clean":"2024-08-31T12:13:51.718986+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:13:51.718986+0000","last_undegraded":"2024-08-31T12:13:51.718986+0000","last_fullsized":"2024-08-31T12:13:51.718986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:47.727595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717721+0000","last_change":"2024-08-31T12:13:46.686595+0000","last_active":"2024-08-31T12:13:51.717721+0000","last_peered":"2024-08-31T12:13:51.717721+0000","last_clean":"2024-08-31T12:13:51.717721+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:13:51.717721+0000","last_undegraded":"2024-08-31T12:13:51.717721+0000","last_fullsized":"2024-08-31T12:13:51.717721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:37:50.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707323+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:13:51.707323+0000","last_peered":"2024-08-31T12:13:51.707323+0000","last_clean":"2024-08-31T12:13:51.707323+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:13:51.707323+0000","last_undegraded":"2024-08-31T12:13:51.707323+0000","last_fullsized":"2024-08-31T12:13:51.707323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708559+0000","last_change":"2024-08-31T12:13:50.718512+0000","last_active":"2024-08-31T12:13:51.708559+0000","last_peered":"2024-08-31T12:13:51.708559+0000","last_clean":"2024-08-31T12:13:51.708559+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:13:51.708559+0000","last_undegraded":"2024-08-31T12:13:51.708559+0000","last_fullsized":"2024-08-31T12:13:51.708559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:57.948690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399863+0000","last_change":"2024-08-31T12:13:46.702550+0000","last_active":"2024-08-31T12:13:52.399863+0000","last_peered":"2024-08-31T12:13:52.399863+0000","last_clean":"2024-08-31T12:13:52.399863+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:13:52.399863+0000","last_undegraded":"2024-08-31T12:13:52.399863+0000","last_fullsized":"2024-08-31T12:13:52.399863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:02:38.902432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399452+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:13:52.399452+0000","last_peered":"2024-08-31T12:13:52.399452+0000","last_clean":"2024-08-31T12:13:52.399452+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:13:52.399452+0000","last_undegraded":"2024-08-31T12:13:52.399452+0000","last_fullsized":"2024-08-31T12:13:52.399452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707517+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:13:51.707517+0000","last_peered":"2024-08-31T12:13:51.707517+0000","last_clean":"2024-08-31T12:13:51.707517+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:13:51.707517+0000","last_undegraded":"2024-08-31T12:13:51.707517+0000","last_fullsized":"2024-08-31T12:13:51.707517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718236+0000","last_change":"2024-08-31T12:13:46.689310+0000","last_active":"2024-08-31T12:13:51.718236+0000","last_peered":"2024-08-31T12:13:51.718236+0000","last_clean":"2024-08-31T12:13:51.718236+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:13:51.718236+0000","last_undegraded":"2024-08-31T12:13:51.718236+0000","last_fullsized":"2024-08-31T12:13:51.718236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:22.978771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.720016+0000","last_change":"2024-08-31T12:13:50.763527+0000","last_active":"2024-08-31T12:13:51.720016+0000","last_peered":"2024-08-31T12:13:51.720016+0000","last_clean":"2024-08-31T12:13:51.720016+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:13:51.720016+0000","last_undegraded":"2024-08-31T12:13:51.720016+0000","last_fullsized":"2024-08-31T12:13:51.720016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:30:07.476078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401057+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:13:52.401057+0000","last_peered":"2024-08-31T12:13:52.401057+0000","last_clean":"2024-08-31T12:13:52.401057+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:13:52.401057+0000","last_undegraded":"2024-08-31T12:13:52.401057+0000","last_fullsized":"2024-08-31T12:13:52.401057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703248+0000","last_change":"2024-08-31T12:13:46.705123+0000","last_active":"2024-08-31T12:13:51.703248+0000","last_peered":"2024-08-31T12:13:51.703248+0000","last_clean":"2024-08-31T12:13:51.703248+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:13:51.703248+0000","last_undegraded":"2024-08-31T12:13:51.703248+0000","last_fullsized":"2024-08-31T12:13:51.703248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:45.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721917+0000","last_change":"2024-08-31T12:13:50.760665+0000","last_active":"2024-08-31T12:13:51.721917+0000","last_peered":"2024-08-31T12:13:51.721917+0000","last_clean":"2024-08-31T12:13:51.721917+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:13:51.721917+0000","last_undegraded":"2024-08-31T12:13:51.721917+0000","last_fullsized":"2024-08-31T12:13:51.721917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:53.504700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.711764+0000","last_change":"2024-08-31T12:13:46.665213+0000","last_active":"2024-08-31T12:13:51.711764+0000","last_peered":"2024-08-31T12:13:51.711764+0000","last_clean":"2024-08-31T12:13:51.711764+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:13:51.711764+0000","last_undegraded":"2024-08-31T12:13:51.711764+0000","last_fullsized":"2024-08-31T12:13:51.711764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:05:22.397524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.718393+0000","last_change":"2024-08-31T12:13:46.685416+0000","last_active":"2024-08-31T12:13:51.718393+0000","last_peered":"2024-08-31T12:13:51.718393+0000","last_clean":"2024-08-31T12:13:51.718393+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:13:51.718393+0000","last_undegraded":"2024-08-31T12:13:51.718393+0000","last_fullsized":"2024-08-31T12:13:51.718393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:41.280220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707239+0000","last_change":"2024-08-31T12:13:46.711967+0000","last_active":"2024-08-31T12:13:51.707239+0000","last_peered":"2024-08-31T12:13:51.707239+0000","last_clean":"2024-08-31T12:13:51.707239+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:13:51.707239+0000","last_undegraded":"2024-08-31T12:13:51.707239+0000","last_fullsized":"2024-08-31T12:13:51.707239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:33.049722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400863+0000","last_change":"2024-08-31T12:13:46.709008+0000","last_active":"2024-08-31T12:13:52.400863+0000","last_peered":"2024-08-31T12:13:52.400863+0000","last_clean":"2024-08-31T12:13:52.400863+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:13:52.400863+0000","last_undegraded":"2024-08-31T12:13:52.400863+0000","last_fullsized":"2024-08-31T12:13:52.400863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:53.017012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401243+0000","last_change":"2024-08-31T12:13:46.681220+0000","last_active":"2024-08-31T12:13:52.401243+0000","last_peered":"2024-08-31T12:13:52.401243+0000","last_clean":"2024-08-31T12:13:52.401243+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:13:52.401243+0000","last_undegraded":"2024-08-31T12:13:52.401243+0000","last_fullsized":"2024-08-31T12:13:52.401243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:17.807344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.401687+0000","last_change":"2024-08-31T12:13:46.699234+0000","last_active":"2024-08-31T12:13:52.401687+0000","last_peered":"2024-08-31T12:13:52.401687+0000","last_clean":"2024-08-31T12:13:52.401687+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:13:52.401687+0000","last_undegraded":"2024-08-31T12:13:52.401687+0000","last_fullsized":"2024-08-31T12:13:52.401687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:36:57.492823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712512+0000","last_change":"2024-08-31T12:13:46.676454+0000","last_active":"2024-08-31T12:13:51.712512+0000","last_peered":"2024-08-31T12:13:51.712512+0000","last_clean":"2024-08-31T12:13:51.712512+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:13:51.712512+0000","last_undegraded":"2024-08-31T12:13:51.712512+0000","last_fullsized":"2024-08-31T12:13:51.712512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:54.349626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402870+0000","last_change":"2024-08-31T12:13:46.706358+0000","last_active":"2024-08-31T12:13:52.402870+0000","last_peered":"2024-08-31T12:13:52.402870+0000","last_clean":"2024-08-31T12:13:52.402870+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:13:52.402870+0000","last_undegraded":"2024-08-31T12:13:52.402870+0000","last_fullsized":"2024-08-31T12:13:52.402870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:16.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708094+0000","last_change":"2024-08-31T12:13:46.712103+0000","last_active":"2024-08-31T12:13:51.708094+0000","last_peered":"2024-08-31T12:13:51.708094+0000","last_clean":"2024-08-31T12:13:51.708094+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:13:51.708094+0000","last_undegraded":"2024-08-31T12:13:51.708094+0000","last_fullsized":"2024-08-31T12:13:51.708094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:58.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399812+0000","last_change":"2024-08-31T12:13:46.706012+0000","last_active":"2024-08-31T12:13:52.399812+0000","last_peered":"2024-08-31T12:13:52.399812+0000","last_clean":"2024-08-31T12:13:52.399812+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:13:52.399812+0000","last_undegraded":"2024-08-31T12:13:52.399812+0000","last_fullsized":"2024-08-31T12:13:52.399812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.894220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.703122+0000","last_change":"2024-08-31T12:13:46.661731+0000","last_active":"2024-08-31T12:13:51.703122+0000","last_peered":"2024-08-31T12:13:51.703122+0000","last_clean":"2024-08-31T12:13:51.703122+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:13:51.703122+0000","last_undegraded":"2024-08-31T12:13:51.703122+0000","last_fullsized":"2024-08-31T12:13:51.703122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:44.646463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.717845+0000","last_change":"2024-08-31T12:13:46.697594+0000","last_active":"2024-08-31T12:13:51.717845+0000","last_peered":"2024-08-31T12:13:51.717845+0000","last_clean":"2024-08-31T12:13:51.717845+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:13:51.717845+0000","last_undegraded":"2024-08-31T12:13:51.717845+0000","last_fullsized":"2024-08-31T12:13:51.717845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:21.232452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397157+0000","last_change":"2024-08-31T12:13:46.667252+0000","last_active":"2024-08-31T12:13:52.397157+0000","last_peered":"2024-08-31T12:13:52.397157+0000","last_clean":"2024-08-31T12:13:52.397157+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:13:52.397157+0000","last_undegraded":"2024-08-31T12:13:52.397157+0000","last_fullsized":"2024-08-31T12:13:52.397157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:10.980177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708747+0000","last_change":"2024-08-31T12:13:46.688329+0000","last_active":"2024-08-31T12:13:51.708747+0000","last_peered":"2024-08-31T12:13:51.708747+0000","last_clean":"2024-08-31T12:13:51.708747+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:13:51.708747+0000","last_undegraded":"2024-08-31T12:13:51.708747+0000","last_fullsized":"2024-08-31T12:13:51.708747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:14.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.721650+0000","last_change":"2024-08-31T12:13:46.693001+0000","last_active":"2024-08-31T12:13:51.721650+0000","last_peered":"2024-08-31T12:13:51.721650+0000","last_clean":"2024-08-31T12:13:51.721650+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:13:51.721650+0000","last_undegraded":"2024-08-31T12:13:51.721650+0000","last_fullsized":"2024-08-31T12:13:51.721650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:59:50.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.708849+0000","last_change":"2024-08-31T12:13:46.687548+0000","last_active":"2024-08-31T12:13:51.708849+0000","last_peered":"2024-08-31T12:13:51.708849+0000","last_clean":"2024-08-31T12:13:51.708849+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:13:51.708849+0000","last_undegraded":"2024-08-31T12:13:51.708849+0000","last_fullsized":"2024-08-31T12:13:51.708849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:17.775043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.707113+0000","last_change":"2024-08-31T12:13:46.673269+0000","last_active":"2024-08-31T12:13:51.707113+0000","last_peered":"2024-08-31T12:13:51.707113+0000","last_clean":"2024-08-31T12:13:51.707113+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:13:51.707113+0000","last_undegraded":"2024-08-31T12:13:51.707113+0000","last_fullsized":"2024-08-31T12:13:51.707113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:33:27.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399304+0000","last_change":"2024-08-31T12:13:46.702365+0000","last_active":"2024-08-31T12:13:52.399304+0000","last_peered":"2024-08-31T12:13:52.399304+0000","last_clean":"2024-08-31T12:13:52.399304+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:13:52.399304+0000","last_undegraded":"2024-08-31T12:13:52.399304+0000","last_fullsized":"2024-08-31T12:13:52.399304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:14:06.105376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.399241+0000","last_change":"2024-08-31T12:13:46.677675+0000","last_active":"2024-08-31T12:13:52.399241+0000","last_peered":"2024-08-31T12:13:52.399241+0000","last_clean":"2024-08-31T12:13:52.399241+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:13:52.399241+0000","last_undegraded":"2024-08-31T12:13:52.399241+0000","last_fullsized":"2024-08-31T12:13:52.399241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:14:53.266109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.400655+0000","last_change":"2024-08-31T12:13:46.680384+0000","last_active":"2024-08-31T12:13:52.400655+0000","last_peered":"2024-08-31T12:13:52.400655+0000","last_clean":"2024-08-31T12:13:52.400655+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:13:52.400655+0000","last_undegraded":"2024-08-31T12:13:52.400655+0000","last_fullsized":"2024-08-31T12:13:52.400655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:50.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396934+0000","last_change":"2024-08-31T12:13:46.667269+0000","last_active":"2024-08-31T12:13:52.396934+0000","last_peered":"2024-08-31T12:13:52.396934+0000","last_clean":"2024-08-31T12:13:52.396934+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:13:52.396934+0000","last_undegraded":"2024-08-31T12:13:52.396934+0000","last_fullsized":"2024-08-31T12:13:52.396934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:30.716592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396944+0000","last_change":"2024-08-31T12:13:46.674887+0000","last_active":"2024-08-31T12:13:52.396944+0000","last_peered":"2024-08-31T12:13:52.396944+0000","last_clean":"2024-08-31T12:13:52.396944+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:13:52.396944+0000","last_undegraded":"2024-08-31T12:13:52.396944+0000","last_fullsized":"2024-08-31T12:13:52.396944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:45:14.621209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397106+0000","last_change":"2024-08-31T12:13:46.678544+0000","last_active":"2024-08-31T12:13:52.397106+0000","last_peered":"2024-08-31T12:13:52.397106+0000","last_clean":"2024-08-31T12:13:52.397106+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:13:52.397106+0000","last_undegraded":"2024-08-31T12:13:52.397106+0000","last_fullsized":"2024-08-31T12:13:52.397106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:48.195173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.704292+0000","last_change":"2024-08-31T12:13:46.676731+0000","last_active":"2024-08-31T12:13:51.704292+0000","last_peered":"2024-08-31T12:13:51.704292+0000","last_clean":"2024-08-31T12:13:51.704292+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:13:51.704292+0000","last_undegraded":"2024-08-31T12:13:51.704292+0000","last_fullsized":"2024-08-31T12:13:51.704292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:15.808612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.398967+0000","last_change":"2024-08-31T12:13:46.703261+0000","last_active":"2024-08-31T12:13:52.398967+0000","last_peered":"2024-08-31T12:13:52.398967+0000","last_clean":"2024-08-31T12:13:52.398967+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:13:52.398967+0000","last_undegraded":"2024-08-31T12:13:52.398967+0000","last_fullsized":"2024-08-31T12:13:52.398967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:42:55.752595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396533+0000","last_change":"2024-08-31T12:13:46.691672+0000","last_active":"2024-08-31T12:13:52.396533+0000","last_peered":"2024-08-31T12:13:52.396533+0000","last_clean":"2024-08-31T12:13:52.396533+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:13:52.396533+0000","last_undegraded":"2024-08-31T12:13:52.396533+0000","last_fullsized":"2024-08-31T12:13:52.396533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:16:38.849268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712086+0000","last_change":"2024-08-31T12:13:46.673059+0000","last_active":"2024-08-31T12:13:51.712086+0000","last_peered":"2024-08-31T12:13:51.712086+0000","last_clean":"2024-08-31T12:13:51.712086+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:13:51.712086+0000","last_undegraded":"2024-08-31T12:13:51.712086+0000","last_fullsized":"2024-08-31T12:13:51.712086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:07:53.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.396796+0000","last_change":"2024-08-31T12:13:46.707550+0000","last_active":"2024-08-31T12:13:52.396796+0000","last_peered":"2024-08-31T12:13:52.396796+0000","last_clean":"2024-08-31T12:13:52.396796+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:13:52.396796+0000","last_undegraded":"2024-08-31T12:13:52.396796+0000","last_fullsized":"2024-08-31T12:13:52.396796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:30:41.195325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:51.712029+0000","last_change":"2024-08-31T12:13:46.700440+0000","last_active":"2024-08-31T12:13:51.712029+0000","last_peered":"2024-08-31T12:13:51.712029+0000","last_clean":"2024-08-31T12:13:51.712029+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:13:51.712029+0000","last_undegraded":"2024-08-31T12:13:51.712029+0000","last_fullsized":"2024-08-31T12:13:51.712029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:48.925135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402440+0000","last_change":"2024-08-31T12:13:46.702925+0000","last_active":"2024-08-31T12:13:52.402440+0000","last_peered":"2024-08-31T12:13:52.402440+0000","last_clean":"2024-08-31T12:13:52.402440+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:13:52.402440+0000","last_undegraded":"2024-08-31T12:13:52.402440+0000","last_fullsized":"2024-08-31T12:13:52.402440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:40.569231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.402686+0000","last_change":"2024-08-31T12:13:46.704131+0000","last_active":"2024-08-31T12:13:52.402686+0000","last_peered":"2024-08-31T12:13:52.402686+0000","last_clean":"2024-08-31T12:13:52.402686+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:13:52.402686+0000","last_undegraded":"2024-08-31T12:13:52.402686+0000","last_fullsized":"2024-08-31T12:13:52.402686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:33.157916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-08-31T12:13:52.397170+0000","last_change":"2024-08-31T12:13:46.683221+0000","last_active":"2024-08-31T12:13:52.397170+0000","last_peered":"2024-08-31T12:13:52.397170+0000","last_clean":"2024-08-31T12:13:52.397170+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:13:52.397170+0000","last_undegraded":"2024-08-31T12:13:52.397170+0000","last_fullsized":"2024-08-31T12:13:52.397170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:26:27.320310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4899,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:14:27.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 -- 172.21.15.164:0/226868412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 msgr2=0x7f8b100c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 --2- 172.21.15.164:0/226868412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b100c5170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009bf0 tx=0x7f8b0801cae0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 -- 172.21.15.164:0/226868412 shutdown_connections 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 --2- 172.21.15.164:0/226868412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b100c5170 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 -- 172.21.15.164:0/226868412 >> 172.21.15.164:0/226868412 conn(0x7f8b10071aa0 msgr2=0x7f8b10071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 -- 172.21.15.164:0/226868412 shutdown_connections 2024-08-31T12:14:27.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.972+0000 7f8b16c00640 1 -- 172.21.15.164:0/226868412 wait complete. 2024-08-31T12:14:27.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 Processor -- start 2024-08-31T12:14:27.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 -- start start 2024-08-31T12:14:27.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 0x7f8b10154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 0x7f8b101532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100744f0 con 0x7f8b100c4d60 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10074d90 con 0x7f8b100c7f80 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b16c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8b10074670 con 0x7f8b100c64e0 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38646/0 (socket says 172.21.15.164:38646) 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.976+0000 7f8b0fe00640 1 -- 172.21.15.164:0/3402813656 learned_addr learned my addr 172.21.15.164:0/3402813656 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b14c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 0x7f8b101532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 -- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 msgr2=0x7f8b10154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0f400640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 0x7f8b10154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 0x7f8b10154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 -- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 msgr2=0x7f8b101532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 0x7f8b101532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 -- 172.21.15.164:0/3402813656 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b101530c0 con 0x7f8b100c4d60 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b14c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 0x7f8b101532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0f400640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 0x7f8b10154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b0fe00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c3c0 tx=0x7f8b0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00017070 con 0x7f8b100c4d60 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b00003600 con 0x7f8b100c4d60 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b101545b0 con 0x7f8b100c4d60 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00003a50 con 0x7f8b100c4d60 2024-08-31T12:14:27.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b10155670 con 0x7f8b100c4d60 2024-08-31T12:14:27.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b100c7a20 con 0x7f8b100c4d60 2024-08-31T12:14:27.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.980+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8b0001a070 con 0x7f8b100c4d60 2024-08-31T12:14:27.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.984+0000 7f8b07e00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 0x7f8af00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:27.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.984+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8b00092190 con 0x7f8b100c4d60 2024-08-31T12:14:27.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.984+0000 7f8b0f400640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 0x7f8af00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:27.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.984+0000 7f8b0f400640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 0x7f8af00745d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b101f3a50 tx=0x7f8afc009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:27.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:27.988+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8b0005d760 con 0x7f8b100c4d60 2024-08-31T12:14:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.188+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b10155e40 con 0x7f8b100c4d60 2024-08-31T12:14:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.188+0000 7f8b07e00640 1 -- 172.21.15.164:0/3402813656 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f8b0005d060 con 0x7f8b100c4d60 2024-08-31T12:14:28.194 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:28.195 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:14:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 msgr2=0x7f8af00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 0x7f8af00745d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b101f3a50 tx=0x7f8afc009040 comp rx=0 tx=0).stop 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 msgr2=0x7f8b10159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c3c0 tx=0x7f8b0000c880 comp rx=0 tx=0).stop 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 shutdown_connections 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8af00720c0 0x7f8af00745d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b100c7f80 0x7f8b101532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b100c64e0 0x7f8b10154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 --2- 172.21.15.164:0/3402813656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b100c4d60 0x7f8b10159200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 >> 172.21.15.164:0/3402813656 conn(0x7f8b10071aa0 msgr2=0x7f8b10071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:28.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 shutdown_connections 2024-08-31T12:14:28.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.192+0000 7f8b16c00640 1 -- 172.21.15.164:0/3402813656 wait complete. 2024-08-31T12:14:28.217 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 -- 172.21.15.164:0/556955467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937016cbe0 msgr2=0x7f9370173790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 --2- 172.21.15.164:0/556955467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937016cbe0 0x7f9370173790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f936800acd0 tx=0x7f936801def0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 -- 172.21.15.164:0/556955467 shutdown_connections 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 --2- 172.21.15.164:0/556955467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937016cbe0 0x7f9370173790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 --2- 172.21.15.164:0/556955467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93700c5540 0x7f93700c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 -- 172.21.15.164:0/556955467 >> 172.21.15.164:0/556955467 conn(0x7f93700cca80 msgr2=0x7f93700cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.364+0000 7f9376000640 1 -- 172.21.15.164:0/556955467 shutdown_connections 2024-08-31T12:14:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 -- 172.21.15.164:0/556955467 wait complete. 2024-08-31T12:14:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 Processor -- start 2024-08-31T12:14:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 -- start start 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937006e8f0 0x7f9370158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f937016cbe0 0x7f937008b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f93700c4000 con 0x7f93700c5540 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93700c3e80 con 0x7f937006e8f0 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9376000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f937006ed00 con 0x7f937016cbe0 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f936fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f936fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38648/0 (socket says 172.21.15.164:38648) 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f936fe00640 1 -- 172.21.15.164:0/3975761881 learned_addr learned my addr 172.21.15.164:0/3975761881 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.368+0000 7f9374c00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937006e8f0 0x7f9370158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f9375600640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f937016cbe0 0x7f937008b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 -- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f937016cbe0 msgr2=0x7f937008b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f937016cbe0 0x7f937008b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 -- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937006e8f0 msgr2=0x7f9370158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937006e8f0 0x7f9370158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 -- 172.21.15.164:0/3975761881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9370159210 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936fe00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c430 tx=0x7f935c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c011790 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f935c017070 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c011cc0 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9370157ff0 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937020a3f0 con 0x7f93700c5540 2024-08-31T12:14:28.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93700c9270 con 0x7f93700c5540 2024-08-31T12:14:28.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.372+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f935c01c460 con 0x7f93700c5540 2024-08-31T12:14:28.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.376+0000 7f936cc00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 0x7f9350074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:14:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.376+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f935c092c00 con 0x7f93700c5540 2024-08-31T12:14:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.376+0000 7f9374c00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 0x7f9350074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:14:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.376+0000 7f9374c00640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 0x7f9350074600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9364009b40 tx=0x7f93640091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:14:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.380+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f935c05da60 con 0x7f93700c5540 2024-08-31T12:14:28.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.544+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9370167f40 con 0x7f93700c5540 2024-08-31T12:14:28.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.544+0000 7f936cc00640 1 -- 172.21.15.164:0/3975761881 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18757 (secure 0 0 0) 0x7f935c062220 con 0x7f93700c5540 2024-08-31T12:14:28.550 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:14:28.550 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":29,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:14:27.610743+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:14:28.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 msgr2=0x7f9350074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 0x7f9350074600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9364009b40 tx=0x7f93640091e0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 msgr2=0x7f93701fbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c430 tx=0x7f935c00c8f0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 shutdown_connections 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f93500720f0 0x7f9350074600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f937016cbe0 0x7f937008b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93700c5540 0x7f93701fbe40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 --2- 172.21.15.164:0/3975761881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f937006e8f0 0x7f9370158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:14:28.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 >> 172.21.15.164:0/3975761881 conn(0x7f93700cca80 msgr2=0x7f937016a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:14:28.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 shutdown_connections 2024-08-31T12:14:28.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:14:28.548+0000 7f9376000640 1 -- 172.21.15.164:0/3975761881 wait complete. 2024-08-31T12:14:28.572 DEBUG:tasks.mds_thrash:Yielding 2024-08-31T12:14:28.573 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T12:14:28.587 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:14:28.587 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T12:14:28.587 INFO:tasks.workunit:timeout=6h 2024-08-31T12:14:28.587 INFO:tasks.workunit:cleanup=True 2024-08-31T12:14:28.587 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:28.588 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-08-31T12:14:28.588 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 104 secs before thrashing 2024-08-31T12:14:28.596 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:28.596 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T12:14:28.596 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-08-31T12:14:28.596 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:14:28.597 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-31T12:14:28.597 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-08-31 12:13:51.687133596 +0000 2024-08-31T12:14:28.597 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-08-31 12:14:01.319953413 +0000 2024-08-31T12:14:28.597 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-08-31 12:13:51.687133596 +0000 2024-08-31T12:14:28.597 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T12:14:28.597 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T12:14:28.668 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:14:28.720 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T12:14:33.356 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:14:33.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:15:03.422 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:15:03.426 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:15:27.523 INFO:tasks.workunit.client.0.smithi164.stderr:Updating files: 66% (8480/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T12:15:28.320 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: git switch -c 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr:Or undo this operation with: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: git switch - 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-08-31T12:15:28.321 INFO:tasks.workunit.client.0.smithi164.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T12:15:28.331 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T12:15:28.340 INFO:tasks.workunit.client.0.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T12:15:28.342 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T12:15:28.343 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T12:15:29.172 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T12:15:29.264 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T12:15:29.323 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T12:15:29.325 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T12:15:29.325 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T12:15:29.378 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T12:15:29.384 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:15:29.384 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T12:15:29.435 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-08-31T12:15:29.436 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-08-31T12:15:29.436 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-08-31T12:15:29.494 INFO:tasks.workunit.client.0.smithi164.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-08-31T12:15:31.847 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir foo 2024-08-31T12:15:31.854 INFO:tasks.workunit.client.0.smithi164.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-08-31T12:15:31.938 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir foo/.snap/barsnap 2024-08-31T12:15:31.949 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-08-31T12:15:31.958 INFO:tasks.workunit.client.0.smithi164.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-08-31T12:15:32.437 INFO:tasks.workunit.client.0.smithi164.stdout:passed: files are identical 2024-08-31T12:15:32.438 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo passed: files are identical 2024-08-31T12:15:32.438 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir foo/.snap/barsnap 2024-08-31T12:15:32.461 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:15:32.462 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:15:32.462 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:15:32.462 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:15:32.537 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-08-31T12:15:32.537 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-08-31T12:15:32.596 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 1 2024-08-31T12:15:32.597 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 2 2024-08-31T12:15:32.599 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 3 2024-08-31T12:15:32.600 INFO:tasks.workunit.client.0.smithi164.stderr:+ '[' -e file4 ']' 2024-08-31T12:15:32.600 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir .snap/snap1 2024-08-31T12:15:32.617 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 4 2024-08-31T12:15:32.619 INFO:tasks.workunit.client.0.smithi164.stderr:++ ls 2024-08-31T12:15:32.625 INFO:tasks.workunit.client.0.smithi164.stderr:+ now='file1 2024-08-31T12:15:32.625 INFO:tasks.workunit.client.0.smithi164.stderr:file2 2024-08-31T12:15:32.625 INFO:tasks.workunit.client.0.smithi164.stderr:file3 2024-08-31T12:15:32.625 INFO:tasks.workunit.client.0.smithi164.stderr:file4' 2024-08-31T12:15:32.625 INFO:tasks.workunit.client.0.smithi164.stderr:++ ls .snap/snap1 2024-08-31T12:15:32.630 INFO:tasks.workunit.client.0.smithi164.stderr:+ then='file1 2024-08-31T12:15:32.630 INFO:tasks.workunit.client.0.smithi164.stderr:file2 2024-08-31T12:15:32.630 INFO:tasks.workunit.client.0.smithi164.stderr:file3' 2024-08-31T12:15:32.630 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir .snap/snap1 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:+ '[' 'file1 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:file2 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:file3 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:file4' = 'file1 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:file2 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:file3' ']' 2024-08-31T12:15:32.639 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 1 2024-08-31T12:15:32.649 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 2 2024-08-31T12:15:32.659 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 3 2024-08-31T12:15:32.672 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir .snap/snap1 2024-08-31T12:15:32.687 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo 4 2024-08-31T12:15:32.941 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir .snap/snap1 2024-08-31T12:15:32.952 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm file1 file2 file3 file4 2024-08-31T12:15:32.960 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:15:32.962 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:15:32.962 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:15:32.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:15:33.029 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-08-31T12:15:33.029 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-08-31T12:15:33.087 INFO:tasks.workunit.client.0.smithi164.stdout:Create dir 100 to 199 ... 2024-08-31T12:15:33.089 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 100 2024-08-31T12:15:33.103 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 101 2024-08-31T12:15:33.118 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 102 2024-08-31T12:15:33.132 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 103 2024-08-31T12:15:33.146 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 104 2024-08-31T12:15:33.161 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 105 2024-08-31T12:15:33.176 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 106 2024-08-31T12:15:33.195 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 107 2024-08-31T12:15:33.214 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 108 2024-08-31T12:15:33.234 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 109 2024-08-31T12:15:33.253 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 110 2024-08-31T12:15:33.271 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 111 2024-08-31T12:15:33.285 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 112 2024-08-31T12:15:33.300 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 113 2024-08-31T12:15:33.314 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 114 2024-08-31T12:15:33.328 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 115 2024-08-31T12:15:33.342 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 116 2024-08-31T12:15:33.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:15:33.489 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:15:34.338 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 117 2024-08-31T12:15:34.355 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 118 2024-08-31T12:15:34.371 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 119 2024-08-31T12:15:34.387 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 120 2024-08-31T12:15:34.402 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 121 2024-08-31T12:15:34.417 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 122 2024-08-31T12:15:34.432 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 123 2024-08-31T12:15:34.447 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 124 2024-08-31T12:15:34.461 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 125 2024-08-31T12:15:34.476 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 126 2024-08-31T12:15:34.491 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 127 2024-08-31T12:15:34.508 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 128 2024-08-31T12:15:34.524 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 129 2024-08-31T12:15:34.544 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 130 2024-08-31T12:15:34.563 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 131 2024-08-31T12:15:34.578 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 132 2024-08-31T12:15:34.592 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 133 2024-08-31T12:15:34.606 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 134 2024-08-31T12:15:34.621 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 135 2024-08-31T12:15:34.636 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 136 2024-08-31T12:15:34.650 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 137 2024-08-31T12:15:34.664 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 138 2024-08-31T12:15:34.679 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 139 2024-08-31T12:15:34.693 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 140 2024-08-31T12:15:34.708 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 141 2024-08-31T12:15:34.733 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 142 2024-08-31T12:15:34.754 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 143 2024-08-31T12:15:34.772 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 144 2024-08-31T12:15:34.786 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 145 2024-08-31T12:15:34.808 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 146 2024-08-31T12:15:34.825 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 147 2024-08-31T12:15:34.839 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 148 2024-08-31T12:15:34.852 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 149 2024-08-31T12:15:34.866 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 150 2024-08-31T12:15:34.880 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 151 2024-08-31T12:15:35.145 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 152 2024-08-31T12:15:35.159 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 153 2024-08-31T12:15:35.213 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 154 2024-08-31T12:15:35.228 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 155 2024-08-31T12:15:35.242 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 156 2024-08-31T12:15:35.949 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 157 2024-08-31T12:15:35.964 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 158 2024-08-31T12:15:35.979 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 159 2024-08-31T12:15:35.994 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 160 2024-08-31T12:15:36.009 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 161 2024-08-31T12:15:36.024 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 162 2024-08-31T12:15:36.039 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 163 2024-08-31T12:15:36.053 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 164 2024-08-31T12:15:36.067 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 165 2024-08-31T12:15:36.082 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 166 2024-08-31T12:15:36.097 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 167 2024-08-31T12:15:36.111 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 168 2024-08-31T12:15:36.125 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 169 2024-08-31T12:15:36.140 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 170 2024-08-31T12:15:36.154 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 171 2024-08-31T12:15:36.957 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 172 2024-08-31T12:15:36.972 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 173 2024-08-31T12:15:36.986 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 174 2024-08-31T12:15:37.001 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 175 2024-08-31T12:15:37.015 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 176 2024-08-31T12:15:37.030 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 177 2024-08-31T12:15:37.044 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 178 2024-08-31T12:15:37.058 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 179 2024-08-31T12:15:37.072 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 180 2024-08-31T12:15:37.086 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 181 2024-08-31T12:15:37.101 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 182 2024-08-31T12:15:38.506 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 183 2024-08-31T12:15:38.528 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 184 2024-08-31T12:15:38.545 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 185 2024-08-31T12:15:38.563 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 186 2024-08-31T12:15:38.581 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 187 2024-08-31T12:15:38.600 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 188 2024-08-31T12:15:38.617 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 189 2024-08-31T12:15:38.632 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 190 2024-08-31T12:15:38.647 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 191 2024-08-31T12:15:38.661 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 192 2024-08-31T12:15:39.373 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 193 2024-08-31T12:15:39.395 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 194 2024-08-31T12:15:39.416 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 195 2024-08-31T12:15:39.436 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 196 2024-08-31T12:15:39.457 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 197 2024-08-31T12:15:39.721 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 198 2024-08-31T12:15:39.740 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 199 2024-08-31T12:15:40.399 INFO:tasks.workunit.client.0.smithi164.stdout:Take first snapshot .snap/test1 2024-08-31T12:15:40.523 INFO:tasks.workunit.client.0.smithi164.stdout:Create dir 200 to 299 ... 2024-08-31T12:15:40.525 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 200 2024-08-31T12:15:40.838 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 201 2024-08-31T12:15:40.857 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 202 2024-08-31T12:15:40.874 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 203 2024-08-31T12:15:40.892 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 204 2024-08-31T12:15:40.910 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 205 2024-08-31T12:15:40.928 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 206 2024-08-31T12:15:40.946 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 207 2024-08-31T12:15:40.964 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 208 2024-08-31T12:15:40.981 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 209 2024-08-31T12:15:40.999 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 210 2024-08-31T12:15:41.246 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 211 2024-08-31T12:15:41.264 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 212 2024-08-31T12:15:41.281 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 213 2024-08-31T12:15:41.299 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 214 2024-08-31T12:15:41.317 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 215 2024-08-31T12:15:41.330 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 216 2024-08-31T12:15:41.594 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 217 2024-08-31T12:15:41.608 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 218 2024-08-31T12:15:41.626 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 219 2024-08-31T12:15:41.644 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 220 2024-08-31T12:15:41.659 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 221 2024-08-31T12:15:41.673 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 222 2024-08-31T12:15:41.692 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 223 2024-08-31T12:15:41.710 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 224 2024-08-31T12:15:41.724 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 225 2024-08-31T12:15:41.987 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 226 2024-08-31T12:15:42.000 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 227 2024-08-31T12:15:43.038 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 228 2024-08-31T12:15:43.405 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 229 2024-08-31T12:15:43.419 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 230 2024-08-31T12:15:43.433 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 231 2024-08-31T12:15:43.446 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 232 2024-08-31T12:15:43.459 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 233 2024-08-31T12:15:43.473 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 234 2024-08-31T12:15:43.486 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 235 2024-08-31T12:15:43.499 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 236 2024-08-31T12:15:43.512 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 237 2024-08-31T12:15:43.525 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 238 2024-08-31T12:15:43.538 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 239 2024-08-31T12:15:43.643 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 240 2024-08-31T12:15:43.656 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 241 2024-08-31T12:15:43.669 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 242 2024-08-31T12:15:43.682 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 243 2024-08-31T12:15:43.694 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 244 2024-08-31T12:15:43.707 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 245 2024-08-31T12:15:43.721 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 246 2024-08-31T12:15:43.733 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 247 2024-08-31T12:15:43.746 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 248 2024-08-31T12:15:43.760 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 249 2024-08-31T12:15:43.773 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 250 2024-08-31T12:15:43.788 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 251 2024-08-31T12:15:47.777 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 252 2024-08-31T12:15:47.796 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 253 2024-08-31T12:15:47.815 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 254 2024-08-31T12:15:47.830 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 255 2024-08-31T12:15:47.844 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 256 2024-08-31T12:15:47.858 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 257 2024-08-31T12:15:48.227 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 258 2024-08-31T12:15:48.241 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 259 2024-08-31T12:15:48.255 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 260 2024-08-31T12:15:48.269 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 261 2024-08-31T12:15:48.282 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 262 2024-08-31T12:15:48.295 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 263 2024-08-31T12:15:48.308 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 264 2024-08-31T12:15:48.321 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 265 2024-08-31T12:15:48.334 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 266 2024-08-31T12:15:48.348 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 267 2024-08-31T12:15:48.361 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 268 2024-08-31T12:15:48.375 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 269 2024-08-31T12:15:48.392 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 270 2024-08-31T12:15:48.407 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 271 2024-08-31T12:15:48.423 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 272 2024-08-31T12:15:48.440 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 273 2024-08-31T12:15:48.455 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 274 2024-08-31T12:15:48.469 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 275 2024-08-31T12:15:48.483 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 276 2024-08-31T12:15:48.497 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 277 2024-08-31T12:15:48.510 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 278 2024-08-31T12:15:48.524 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 279 2024-08-31T12:15:48.538 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 280 2024-08-31T12:15:48.552 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 281 2024-08-31T12:15:48.565 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 282 2024-08-31T12:15:48.579 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 283 2024-08-31T12:15:48.593 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 284 2024-08-31T12:15:48.606 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 285 2024-08-31T12:15:48.620 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 286 2024-08-31T12:15:48.633 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 287 2024-08-31T12:15:48.647 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 288 2024-08-31T12:15:48.665 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 289 2024-08-31T12:15:48.683 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 290 2024-08-31T12:15:48.701 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 291 2024-08-31T12:15:48.719 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 292 2024-08-31T12:15:48.737 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 293 2024-08-31T12:15:48.755 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 294 2024-08-31T12:15:48.770 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 295 2024-08-31T12:15:48.784 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 296 2024-08-31T12:15:48.797 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 297 2024-08-31T12:15:48.810 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 298 2024-08-31T12:15:48.824 INFO:tasks.workunit.client.0.smithi164.stdout: create dir 299 2024-08-31T12:15:48.837 INFO:tasks.workunit.client.0.smithi164.stdout:Create a snapshot in every first level dir ... 2024-08-31T12:15:49.423 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/.snap/snap-subdir-test 2024-08-31T12:15:49.438 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/30 file after the snapshot 2024-08-31T12:15:49.441 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/31 file after the snapshot 2024-08-31T12:15:49.444 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/32 file after the snapshot 2024-08-31T12:15:49.446 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/33 file after the snapshot 2024-08-31T12:15:49.450 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/34 file after the snapshot 2024-08-31T12:15:49.453 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/35 file after the snapshot 2024-08-31T12:15:49.459 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/36 file after the snapshot 2024-08-31T12:15:49.460 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/37 file after the snapshot 2024-08-31T12:15:49.461 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/38 file after the snapshot 2024-08-31T12:15:49.462 INFO:tasks.workunit.client.0.smithi164.stdout: create 100/39 file after the snapshot 2024-08-31T12:15:49.463 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/.snap/snap-subdir-test 2024-08-31T12:15:49.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/30 file after the snapshot 2024-08-31T12:15:49.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/31 file after the snapshot 2024-08-31T12:15:49.494 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/32 file after the snapshot 2024-08-31T12:15:49.496 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/33 file after the snapshot 2024-08-31T12:15:49.500 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/34 file after the snapshot 2024-08-31T12:15:49.506 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/35 file after the snapshot 2024-08-31T12:15:50.304 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/36 file after the snapshot 2024-08-31T12:15:50.305 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/37 file after the snapshot 2024-08-31T12:15:50.306 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/38 file after the snapshot 2024-08-31T12:15:50.307 INFO:tasks.workunit.client.0.smithi164.stdout: create 101/39 file after the snapshot 2024-08-31T12:15:50.308 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/.snap/snap-subdir-test 2024-08-31T12:15:50.340 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/30 file after the snapshot 2024-08-31T12:15:50.343 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/31 file after the snapshot 2024-08-31T12:15:50.346 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/32 file after the snapshot 2024-08-31T12:15:50.348 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/33 file after the snapshot 2024-08-31T12:15:50.353 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/34 file after the snapshot 2024-08-31T12:15:50.356 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/35 file after the snapshot 2024-08-31T12:15:50.360 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/36 file after the snapshot 2024-08-31T12:15:50.360 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/37 file after the snapshot 2024-08-31T12:15:50.361 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/38 file after the snapshot 2024-08-31T12:15:50.362 INFO:tasks.workunit.client.0.smithi164.stdout: create 102/39 file after the snapshot 2024-08-31T12:15:50.363 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/.snap/snap-subdir-test 2024-08-31T12:15:50.389 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/30 file after the snapshot 2024-08-31T12:15:50.390 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/31 file after the snapshot 2024-08-31T12:15:50.391 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/32 file after the snapshot 2024-08-31T12:15:50.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/33 file after the snapshot 2024-08-31T12:15:50.396 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/34 file after the snapshot 2024-08-31T12:15:50.399 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/35 file after the snapshot 2024-08-31T12:15:50.404 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/36 file after the snapshot 2024-08-31T12:15:50.500 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/37 file after the snapshot 2024-08-31T12:15:50.732 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/38 file after the snapshot 2024-08-31T12:15:50.733 INFO:tasks.workunit.client.0.smithi164.stdout: create 103/39 file after the snapshot 2024-08-31T12:15:50.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/.snap/snap-subdir-test 2024-08-31T12:15:50.761 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/30 file after the snapshot 2024-08-31T12:15:50.763 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/31 file after the snapshot 2024-08-31T12:15:50.765 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/32 file after the snapshot 2024-08-31T12:15:50.766 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/33 file after the snapshot 2024-08-31T12:15:50.769 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/34 file after the snapshot 2024-08-31T12:15:50.776 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/35 file after the snapshot 2024-08-31T12:15:50.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/36 file after the snapshot 2024-08-31T12:15:50.783 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/37 file after the snapshot 2024-08-31T12:15:50.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/38 file after the snapshot 2024-08-31T12:15:50.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 104/39 file after the snapshot 2024-08-31T12:15:50.786 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/.snap/snap-subdir-test 2024-08-31T12:15:52.490 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/30 file after the snapshot 2024-08-31T12:15:52.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/31 file after the snapshot 2024-08-31T12:15:52.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/32 file after the snapshot 2024-08-31T12:15:52.507 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/33 file after the snapshot 2024-08-31T12:15:52.510 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/34 file after the snapshot 2024-08-31T12:15:52.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/35 file after the snapshot 2024-08-31T12:15:52.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/36 file after the snapshot 2024-08-31T12:15:52.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/37 file after the snapshot 2024-08-31T12:15:52.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/38 file after the snapshot 2024-08-31T12:15:52.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 105/39 file after the snapshot 2024-08-31T12:15:52.522 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/.snap/snap-subdir-test 2024-08-31T12:15:52.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/30 file after the snapshot 2024-08-31T12:15:52.546 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/31 file after the snapshot 2024-08-31T12:15:52.548 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/32 file after the snapshot 2024-08-31T12:15:52.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/33 file after the snapshot 2024-08-31T12:15:52.556 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/34 file after the snapshot 2024-08-31T12:15:52.564 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/35 file after the snapshot 2024-08-31T12:15:52.565 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/36 file after the snapshot 2024-08-31T12:15:52.566 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/37 file after the snapshot 2024-08-31T12:15:52.567 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/38 file after the snapshot 2024-08-31T12:15:52.568 INFO:tasks.workunit.client.0.smithi164.stdout: create 106/39 file after the snapshot 2024-08-31T12:15:52.569 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/.snap/snap-subdir-test 2024-08-31T12:15:52.594 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/30 file after the snapshot 2024-08-31T12:15:52.596 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/31 file after the snapshot 2024-08-31T12:15:52.598 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/32 file after the snapshot 2024-08-31T12:15:52.599 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/33 file after the snapshot 2024-08-31T12:15:52.602 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/34 file after the snapshot 2024-08-31T12:15:52.604 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/35 file after the snapshot 2024-08-31T12:15:52.608 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/36 file after the snapshot 2024-08-31T12:15:52.618 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/37 file after the snapshot 2024-08-31T12:15:52.619 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/38 file after the snapshot 2024-08-31T12:15:52.620 INFO:tasks.workunit.client.0.smithi164.stdout: create 107/39 file after the snapshot 2024-08-31T12:15:52.622 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/.snap/snap-subdir-test 2024-08-31T12:15:52.651 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/30 file after the snapshot 2024-08-31T12:15:52.653 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/31 file after the snapshot 2024-08-31T12:15:52.654 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/32 file after the snapshot 2024-08-31T12:15:52.656 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/33 file after the snapshot 2024-08-31T12:15:52.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/34 file after the snapshot 2024-08-31T12:15:52.668 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/35 file after the snapshot 2024-08-31T12:15:52.677 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/36 file after the snapshot 2024-08-31T12:15:52.678 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/37 file after the snapshot 2024-08-31T12:15:52.680 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/38 file after the snapshot 2024-08-31T12:15:52.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 108/39 file after the snapshot 2024-08-31T12:15:52.682 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/.snap/snap-subdir-test 2024-08-31T12:15:52.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/30 file after the snapshot 2024-08-31T12:15:52.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/31 file after the snapshot 2024-08-31T12:15:52.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/32 file after the snapshot 2024-08-31T12:15:52.713 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/33 file after the snapshot 2024-08-31T12:15:52.718 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/34 file after the snapshot 2024-08-31T12:15:52.726 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/35 file after the snapshot 2024-08-31T12:15:52.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/36 file after the snapshot 2024-08-31T12:15:52.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/37 file after the snapshot 2024-08-31T12:15:52.730 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/38 file after the snapshot 2024-08-31T12:15:52.731 INFO:tasks.workunit.client.0.smithi164.stdout: create 109/39 file after the snapshot 2024-08-31T12:15:52.732 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/.snap/snap-subdir-test 2024-08-31T12:15:52.768 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/30 file after the snapshot 2024-08-31T12:15:52.769 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/31 file after the snapshot 2024-08-31T12:15:52.771 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/32 file after the snapshot 2024-08-31T12:15:52.772 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/33 file after the snapshot 2024-08-31T12:15:52.775 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/34 file after the snapshot 2024-08-31T12:15:52.779 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/35 file after the snapshot 2024-08-31T12:15:52.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/36 file after the snapshot 2024-08-31T12:15:52.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/37 file after the snapshot 2024-08-31T12:15:52.789 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/38 file after the snapshot 2024-08-31T12:15:52.790 INFO:tasks.workunit.client.0.smithi164.stdout: create 110/39 file after the snapshot 2024-08-31T12:15:52.791 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/.snap/snap-subdir-test 2024-08-31T12:15:52.815 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/30 file after the snapshot 2024-08-31T12:15:52.816 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/31 file after the snapshot 2024-08-31T12:15:52.818 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/32 file after the snapshot 2024-08-31T12:15:52.820 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/33 file after the snapshot 2024-08-31T12:15:52.821 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/34 file after the snapshot 2024-08-31T12:15:52.823 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/35 file after the snapshot 2024-08-31T12:15:52.824 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/36 file after the snapshot 2024-08-31T12:15:52.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/37 file after the snapshot 2024-08-31T12:15:52.832 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/38 file after the snapshot 2024-08-31T12:15:52.838 INFO:tasks.workunit.client.0.smithi164.stdout: create 111/39 file after the snapshot 2024-08-31T12:15:52.839 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/.snap/snap-subdir-test 2024-08-31T12:15:52.864 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/30 file after the snapshot 2024-08-31T12:15:52.865 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/31 file after the snapshot 2024-08-31T12:15:52.866 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/32 file after the snapshot 2024-08-31T12:15:52.869 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/33 file after the snapshot 2024-08-31T12:15:52.875 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/34 file after the snapshot 2024-08-31T12:15:52.881 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/35 file after the snapshot 2024-08-31T12:15:52.882 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/36 file after the snapshot 2024-08-31T12:15:52.883 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/37 file after the snapshot 2024-08-31T12:15:52.884 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/38 file after the snapshot 2024-08-31T12:15:52.885 INFO:tasks.workunit.client.0.smithi164.stdout: create 112/39 file after the snapshot 2024-08-31T12:15:52.886 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/.snap/snap-subdir-test 2024-08-31T12:15:53.418 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/30 file after the snapshot 2024-08-31T12:15:53.419 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/31 file after the snapshot 2024-08-31T12:15:53.420 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/32 file after the snapshot 2024-08-31T12:15:53.422 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/33 file after the snapshot 2024-08-31T12:15:53.424 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/34 file after the snapshot 2024-08-31T12:15:53.430 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/35 file after the snapshot 2024-08-31T12:15:53.439 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/36 file after the snapshot 2024-08-31T12:15:53.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/37 file after the snapshot 2024-08-31T12:15:53.441 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/38 file after the snapshot 2024-08-31T12:15:53.442 INFO:tasks.workunit.client.0.smithi164.stdout: create 113/39 file after the snapshot 2024-08-31T12:15:53.444 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/.snap/snap-subdir-test 2024-08-31T12:15:53.473 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/30 file after the snapshot 2024-08-31T12:15:53.474 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/31 file after the snapshot 2024-08-31T12:15:53.475 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/32 file after the snapshot 2024-08-31T12:15:53.477 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/33 file after the snapshot 2024-08-31T12:15:53.479 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/34 file after the snapshot 2024-08-31T12:15:53.483 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/35 file after the snapshot 2024-08-31T12:15:53.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/36 file after the snapshot 2024-08-31T12:15:53.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/37 file after the snapshot 2024-08-31T12:15:53.494 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/38 file after the snapshot 2024-08-31T12:15:53.496 INFO:tasks.workunit.client.0.smithi164.stdout: create 114/39 file after the snapshot 2024-08-31T12:15:53.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/.snap/snap-subdir-test 2024-08-31T12:15:53.520 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/30 file after the snapshot 2024-08-31T12:15:53.522 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/31 file after the snapshot 2024-08-31T12:15:53.523 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/32 file after the snapshot 2024-08-31T12:15:53.525 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/33 file after the snapshot 2024-08-31T12:15:53.528 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/34 file after the snapshot 2024-08-31T12:15:53.530 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/35 file after the snapshot 2024-08-31T12:15:53.537 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/36 file after the snapshot 2024-08-31T12:15:53.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/37 file after the snapshot 2024-08-31T12:15:53.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/38 file after the snapshot 2024-08-31T12:15:53.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 115/39 file after the snapshot 2024-08-31T12:15:53.543 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/.snap/snap-subdir-test 2024-08-31T12:15:53.571 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/30 file after the snapshot 2024-08-31T12:15:53.572 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/31 file after the snapshot 2024-08-31T12:15:53.574 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/32 file after the snapshot 2024-08-31T12:15:53.577 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/33 file after the snapshot 2024-08-31T12:15:53.580 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/34 file after the snapshot 2024-08-31T12:15:53.587 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/35 file after the snapshot 2024-08-31T12:15:53.589 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/36 file after the snapshot 2024-08-31T12:15:53.590 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/37 file after the snapshot 2024-08-31T12:15:53.591 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/38 file after the snapshot 2024-08-31T12:15:53.592 INFO:tasks.workunit.client.0.smithi164.stdout: create 116/39 file after the snapshot 2024-08-31T12:15:53.593 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/.snap/snap-subdir-test 2024-08-31T12:15:53.617 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/30 file after the snapshot 2024-08-31T12:15:53.618 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/31 file after the snapshot 2024-08-31T12:15:53.620 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/32 file after the snapshot 2024-08-31T12:15:53.622 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/33 file after the snapshot 2024-08-31T12:15:53.623 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/34 file after the snapshot 2024-08-31T12:15:53.629 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/35 file after the snapshot 2024-08-31T12:15:53.637 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/36 file after the snapshot 2024-08-31T12:15:53.638 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/37 file after the snapshot 2024-08-31T12:15:53.639 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/38 file after the snapshot 2024-08-31T12:15:53.640 INFO:tasks.workunit.client.0.smithi164.stdout: create 117/39 file after the snapshot 2024-08-31T12:15:53.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/.snap/snap-subdir-test 2024-08-31T12:15:53.668 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/30 file after the snapshot 2024-08-31T12:15:53.670 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/31 file after the snapshot 2024-08-31T12:15:53.671 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/32 file after the snapshot 2024-08-31T12:15:53.674 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/33 file after the snapshot 2024-08-31T12:15:53.677 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/34 file after the snapshot 2024-08-31T12:15:53.680 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/35 file after the snapshot 2024-08-31T12:15:53.683 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/36 file after the snapshot 2024-08-31T12:15:53.689 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/37 file after the snapshot 2024-08-31T12:15:53.690 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/38 file after the snapshot 2024-08-31T12:15:53.691 INFO:tasks.workunit.client.0.smithi164.stdout: create 118/39 file after the snapshot 2024-08-31T12:15:53.692 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/.snap/snap-subdir-test 2024-08-31T12:15:53.716 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/30 file after the snapshot 2024-08-31T12:15:53.718 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/31 file after the snapshot 2024-08-31T12:15:53.719 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/32 file after the snapshot 2024-08-31T12:15:53.721 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/33 file after the snapshot 2024-08-31T12:15:53.725 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/34 file after the snapshot 2024-08-31T12:15:53.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/35 file after the snapshot 2024-08-31T12:15:53.735 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/36 file after the snapshot 2024-08-31T12:15:53.736 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/37 file after the snapshot 2024-08-31T12:15:53.737 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/38 file after the snapshot 2024-08-31T12:15:53.738 INFO:tasks.workunit.client.0.smithi164.stdout: create 119/39 file after the snapshot 2024-08-31T12:15:53.739 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/.snap/snap-subdir-test 2024-08-31T12:15:53.765 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/30 file after the snapshot 2024-08-31T12:15:53.766 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/31 file after the snapshot 2024-08-31T12:15:53.768 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/32 file after the snapshot 2024-08-31T12:15:53.773 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/33 file after the snapshot 2024-08-31T12:15:53.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/34 file after the snapshot 2024-08-31T12:15:53.783 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/35 file after the snapshot 2024-08-31T12:15:53.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/36 file after the snapshot 2024-08-31T12:15:53.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/37 file after the snapshot 2024-08-31T12:15:53.786 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/38 file after the snapshot 2024-08-31T12:15:53.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 120/39 file after the snapshot 2024-08-31T12:15:53.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/.snap/snap-subdir-test 2024-08-31T12:15:53.811 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/30 file after the snapshot 2024-08-31T12:15:53.813 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/31 file after the snapshot 2024-08-31T12:15:53.817 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/32 file after the snapshot 2024-08-31T12:15:53.822 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/33 file after the snapshot 2024-08-31T12:15:53.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/34 file after the snapshot 2024-08-31T12:15:53.830 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/35 file after the snapshot 2024-08-31T12:15:53.831 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/36 file after the snapshot 2024-08-31T12:15:53.832 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/37 file after the snapshot 2024-08-31T12:15:53.833 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/38 file after the snapshot 2024-08-31T12:15:53.834 INFO:tasks.workunit.client.0.smithi164.stdout: create 121/39 file after the snapshot 2024-08-31T12:15:53.835 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/.snap/snap-subdir-test 2024-08-31T12:15:53.862 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/30 file after the snapshot 2024-08-31T12:15:53.863 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/31 file after the snapshot 2024-08-31T12:15:53.865 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/32 file after the snapshot 2024-08-31T12:15:53.871 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/33 file after the snapshot 2024-08-31T12:15:54.436 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/34 file after the snapshot 2024-08-31T12:15:54.628 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/35 file after the snapshot 2024-08-31T12:15:54.629 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/36 file after the snapshot 2024-08-31T12:15:54.630 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/37 file after the snapshot 2024-08-31T12:15:54.631 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/38 file after the snapshot 2024-08-31T12:15:54.633 INFO:tasks.workunit.client.0.smithi164.stdout: create 122/39 file after the snapshot 2024-08-31T12:15:54.634 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/.snap/snap-subdir-test 2024-08-31T12:15:54.654 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/30 file after the snapshot 2024-08-31T12:15:54.655 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/31 file after the snapshot 2024-08-31T12:15:54.657 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/32 file after the snapshot 2024-08-31T12:15:54.659 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/33 file after the snapshot 2024-08-31T12:15:54.663 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/34 file after the snapshot 2024-08-31T12:15:54.672 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/35 file after the snapshot 2024-08-31T12:15:54.675 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/36 file after the snapshot 2024-08-31T12:15:54.676 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/37 file after the snapshot 2024-08-31T12:15:54.677 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/38 file after the snapshot 2024-08-31T12:15:54.678 INFO:tasks.workunit.client.0.smithi164.stdout: create 123/39 file after the snapshot 2024-08-31T12:15:54.680 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/.snap/snap-subdir-test 2024-08-31T12:15:54.702 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/30 file after the snapshot 2024-08-31T12:15:54.707 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/31 file after the snapshot 2024-08-31T12:15:54.713 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/32 file after the snapshot 2024-08-31T12:15:54.722 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/33 file after the snapshot 2024-08-31T12:15:55.282 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/34 file after the snapshot 2024-08-31T12:15:55.283 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/35 file after the snapshot 2024-08-31T12:15:55.284 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/36 file after the snapshot 2024-08-31T12:15:55.285 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/37 file after the snapshot 2024-08-31T12:15:55.286 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/38 file after the snapshot 2024-08-31T12:15:55.287 INFO:tasks.workunit.client.0.smithi164.stdout: create 124/39 file after the snapshot 2024-08-31T12:15:55.288 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/.snap/snap-subdir-test 2024-08-31T12:15:55.311 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/30 file after the snapshot 2024-08-31T12:15:55.313 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/31 file after the snapshot 2024-08-31T12:15:55.317 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/32 file after the snapshot 2024-08-31T12:15:55.325 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/33 file after the snapshot 2024-08-31T12:15:55.329 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/34 file after the snapshot 2024-08-31T12:15:55.329 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/35 file after the snapshot 2024-08-31T12:15:55.330 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/36 file after the snapshot 2024-08-31T12:15:55.331 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/37 file after the snapshot 2024-08-31T12:15:55.332 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/38 file after the snapshot 2024-08-31T12:15:55.333 INFO:tasks.workunit.client.0.smithi164.stdout: create 125/39 file after the snapshot 2024-08-31T12:15:55.334 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/.snap/snap-subdir-test 2024-08-31T12:15:55.362 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/30 file after the snapshot 2024-08-31T12:15:55.363 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/31 file after the snapshot 2024-08-31T12:15:55.365 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/32 file after the snapshot 2024-08-31T12:15:55.366 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/33 file after the snapshot 2024-08-31T12:15:55.368 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/34 file after the snapshot 2024-08-31T12:15:55.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/35 file after the snapshot 2024-08-31T12:15:55.377 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/36 file after the snapshot 2024-08-31T12:15:55.389 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/37 file after the snapshot 2024-08-31T12:15:55.391 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/38 file after the snapshot 2024-08-31T12:15:55.392 INFO:tasks.workunit.client.0.smithi164.stdout: create 126/39 file after the snapshot 2024-08-31T12:15:55.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/.snap/snap-subdir-test 2024-08-31T12:15:55.418 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/30 file after the snapshot 2024-08-31T12:15:55.420 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/31 file after the snapshot 2024-08-31T12:15:55.420 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/32 file after the snapshot 2024-08-31T12:15:55.422 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/33 file after the snapshot 2024-08-31T12:15:55.423 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/34 file after the snapshot 2024-08-31T12:15:55.427 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/35 file after the snapshot 2024-08-31T12:15:55.435 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/36 file after the snapshot 2024-08-31T12:15:55.438 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/37 file after the snapshot 2024-08-31T12:15:55.439 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/38 file after the snapshot 2024-08-31T12:15:55.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 127/39 file after the snapshot 2024-08-31T12:15:55.441 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/.snap/snap-subdir-test 2024-08-31T12:15:55.464 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/30 file after the snapshot 2024-08-31T12:15:55.466 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/31 file after the snapshot 2024-08-31T12:15:55.467 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/32 file after the snapshot 2024-08-31T12:15:55.468 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/33 file after the snapshot 2024-08-31T12:15:55.469 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/34 file after the snapshot 2024-08-31T12:15:55.476 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/35 file after the snapshot 2024-08-31T12:15:55.483 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/36 file after the snapshot 2024-08-31T12:15:55.484 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/37 file after the snapshot 2024-08-31T12:15:55.485 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/38 file after the snapshot 2024-08-31T12:15:55.486 INFO:tasks.workunit.client.0.smithi164.stdout: create 128/39 file after the snapshot 2024-08-31T12:15:55.487 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/.snap/snap-subdir-test 2024-08-31T12:15:55.508 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/30 file after the snapshot 2024-08-31T12:15:55.509 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/31 file after the snapshot 2024-08-31T12:15:55.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/32 file after the snapshot 2024-08-31T12:15:55.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/33 file after the snapshot 2024-08-31T12:15:55.523 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/34 file after the snapshot 2024-08-31T12:15:55.526 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/35 file after the snapshot 2024-08-31T12:15:55.527 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/36 file after the snapshot 2024-08-31T12:15:55.528 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/37 file after the snapshot 2024-08-31T12:15:55.529 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/38 file after the snapshot 2024-08-31T12:15:55.530 INFO:tasks.workunit.client.0.smithi164.stdout: create 129/39 file after the snapshot 2024-08-31T12:15:55.531 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/.snap/snap-subdir-test 2024-08-31T12:15:56.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/30 file after the snapshot 2024-08-31T12:15:56.489 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/31 file after the snapshot 2024-08-31T12:15:56.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/32 file after the snapshot 2024-08-31T12:15:56.492 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/33 file after the snapshot 2024-08-31T12:15:56.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/34 file after the snapshot 2024-08-31T12:15:56.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/35 file after the snapshot 2024-08-31T12:15:56.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/36 file after the snapshot 2024-08-31T12:15:56.502 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/37 file after the snapshot 2024-08-31T12:15:56.508 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/38 file after the snapshot 2024-08-31T12:15:56.510 INFO:tasks.workunit.client.0.smithi164.stdout: create 130/39 file after the snapshot 2024-08-31T12:15:56.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/.snap/snap-subdir-test 2024-08-31T12:15:56.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/30 file after the snapshot 2024-08-31T12:15:56.538 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/31 file after the snapshot 2024-08-31T12:15:56.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/32 file after the snapshot 2024-08-31T12:15:56.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/33 file after the snapshot 2024-08-31T12:15:56.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/34 file after the snapshot 2024-08-31T12:15:56.555 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/35 file after the snapshot 2024-08-31T12:15:56.556 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/36 file after the snapshot 2024-08-31T12:15:56.557 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/37 file after the snapshot 2024-08-31T12:15:56.558 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/38 file after the snapshot 2024-08-31T12:15:56.559 INFO:tasks.workunit.client.0.smithi164.stdout: create 131/39 file after the snapshot 2024-08-31T12:15:56.560 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/.snap/snap-subdir-test 2024-08-31T12:15:56.580 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/30 file after the snapshot 2024-08-31T12:15:56.582 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/31 file after the snapshot 2024-08-31T12:15:56.583 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/32 file after the snapshot 2024-08-31T12:15:56.584 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/33 file after the snapshot 2024-08-31T12:15:56.586 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/34 file after the snapshot 2024-08-31T12:15:56.587 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/35 file after the snapshot 2024-08-31T12:15:56.591 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/36 file after the snapshot 2024-08-31T12:15:56.598 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/37 file after the snapshot 2024-08-31T12:15:56.607 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/38 file after the snapshot 2024-08-31T12:15:56.609 INFO:tasks.workunit.client.0.smithi164.stdout: create 132/39 file after the snapshot 2024-08-31T12:15:56.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/.snap/snap-subdir-test 2024-08-31T12:15:56.630 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/30 file after the snapshot 2024-08-31T12:15:56.632 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/31 file after the snapshot 2024-08-31T12:15:56.633 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/32 file after the snapshot 2024-08-31T12:15:56.634 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/33 file after the snapshot 2024-08-31T12:15:56.636 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/34 file after the snapshot 2024-08-31T12:15:56.638 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/35 file after the snapshot 2024-08-31T12:15:56.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/36 file after the snapshot 2024-08-31T12:15:56.649 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/37 file after the snapshot 2024-08-31T12:15:56.657 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/38 file after the snapshot 2024-08-31T12:15:56.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 133/39 file after the snapshot 2024-08-31T12:15:56.660 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/.snap/snap-subdir-test 2024-08-31T12:15:56.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/30 file after the snapshot 2024-08-31T12:15:56.682 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/31 file after the snapshot 2024-08-31T12:15:56.683 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/32 file after the snapshot 2024-08-31T12:15:56.684 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/33 file after the snapshot 2024-08-31T12:15:56.685 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/34 file after the snapshot 2024-08-31T12:15:56.686 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/35 file after the snapshot 2024-08-31T12:15:56.687 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/36 file after the snapshot 2024-08-31T12:15:56.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/37 file after the snapshot 2024-08-31T12:15:56.689 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/38 file after the snapshot 2024-08-31T12:15:56.695 INFO:tasks.workunit.client.0.smithi164.stdout: create 134/39 file after the snapshot 2024-08-31T12:15:56.700 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/.snap/snap-subdir-test 2024-08-31T12:15:56.724 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/30 file after the snapshot 2024-08-31T12:15:56.725 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/31 file after the snapshot 2024-08-31T12:15:56.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/32 file after the snapshot 2024-08-31T12:15:56.980 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/33 file after the snapshot 2024-08-31T12:15:56.986 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/34 file after the snapshot 2024-08-31T12:15:56.987 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/35 file after the snapshot 2024-08-31T12:15:56.988 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/36 file after the snapshot 2024-08-31T12:15:56.989 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/37 file after the snapshot 2024-08-31T12:15:56.990 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/38 file after the snapshot 2024-08-31T12:15:56.991 INFO:tasks.workunit.client.0.smithi164.stdout: create 135/39 file after the snapshot 2024-08-31T12:15:56.992 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/.snap/snap-subdir-test 2024-08-31T12:15:57.013 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/30 file after the snapshot 2024-08-31T12:15:57.016 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/31 file after the snapshot 2024-08-31T12:15:57.017 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/32 file after the snapshot 2024-08-31T12:15:57.018 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/33 file after the snapshot 2024-08-31T12:15:57.021 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/34 file after the snapshot 2024-08-31T12:15:57.028 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/35 file after the snapshot 2024-08-31T12:15:57.448 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/36 file after the snapshot 2024-08-31T12:15:57.659 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/37 file after the snapshot 2024-08-31T12:15:57.660 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/38 file after the snapshot 2024-08-31T12:15:57.661 INFO:tasks.workunit.client.0.smithi164.stdout: create 136/39 file after the snapshot 2024-08-31T12:15:57.663 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/.snap/snap-subdir-test 2024-08-31T12:15:57.687 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/30 file after the snapshot 2024-08-31T12:15:57.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/31 file after the snapshot 2024-08-31T12:15:57.689 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/32 file after the snapshot 2024-08-31T12:15:57.690 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/33 file after the snapshot 2024-08-31T12:15:57.691 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/34 file after the snapshot 2024-08-31T12:15:57.693 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/35 file after the snapshot 2024-08-31T12:15:57.695 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/36 file after the snapshot 2024-08-31T12:15:57.701 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/37 file after the snapshot 2024-08-31T12:15:57.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/38 file after the snapshot 2024-08-31T12:15:57.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 137/39 file after the snapshot 2024-08-31T12:15:57.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/.snap/snap-subdir-test 2024-08-31T12:15:57.733 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/30 file after the snapshot 2024-08-31T12:15:57.735 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/31 file after the snapshot 2024-08-31T12:15:57.740 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/32 file after the snapshot 2024-08-31T12:15:57.756 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/33 file after the snapshot 2024-08-31T12:15:57.757 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/34 file after the snapshot 2024-08-31T12:15:57.758 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/35 file after the snapshot 2024-08-31T12:15:57.759 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/36 file after the snapshot 2024-08-31T12:15:57.760 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/37 file after the snapshot 2024-08-31T12:15:57.761 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/38 file after the snapshot 2024-08-31T12:15:57.762 INFO:tasks.workunit.client.0.smithi164.stdout: create 138/39 file after the snapshot 2024-08-31T12:15:57.763 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/.snap/snap-subdir-test 2024-08-31T12:15:57.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/30 file after the snapshot 2024-08-31T12:15:57.783 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/31 file after the snapshot 2024-08-31T12:15:57.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/32 file after the snapshot 2024-08-31T12:15:57.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/33 file after the snapshot 2024-08-31T12:15:57.791 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/34 file after the snapshot 2024-08-31T12:15:57.800 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/35 file after the snapshot 2024-08-31T12:15:57.800 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/36 file after the snapshot 2024-08-31T12:15:57.801 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/37 file after the snapshot 2024-08-31T12:15:57.802 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/38 file after the snapshot 2024-08-31T12:15:57.803 INFO:tasks.workunit.client.0.smithi164.stdout: create 139/39 file after the snapshot 2024-08-31T12:15:57.804 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/.snap/snap-subdir-test 2024-08-31T12:15:57.832 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/30 file after the snapshot 2024-08-31T12:15:57.835 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/31 file after the snapshot 2024-08-31T12:15:57.845 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/32 file after the snapshot 2024-08-31T12:15:57.854 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/33 file after the snapshot 2024-08-31T12:15:58.000 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/34 file after the snapshot 2024-08-31T12:15:58.001 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/35 file after the snapshot 2024-08-31T12:15:58.002 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/36 file after the snapshot 2024-08-31T12:15:58.004 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/37 file after the snapshot 2024-08-31T12:15:58.005 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/38 file after the snapshot 2024-08-31T12:15:58.006 INFO:tasks.workunit.client.0.smithi164.stdout: create 140/39 file after the snapshot 2024-08-31T12:15:58.007 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/.snap/snap-subdir-test 2024-08-31T12:15:58.029 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/30 file after the snapshot 2024-08-31T12:15:58.030 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/31 file after the snapshot 2024-08-31T12:15:58.033 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/32 file after the snapshot 2024-08-31T12:15:58.035 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/33 file after the snapshot 2024-08-31T12:15:58.039 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/34 file after the snapshot 2024-08-31T12:15:58.046 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/35 file after the snapshot 2024-08-31T12:15:58.047 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/36 file after the snapshot 2024-08-31T12:15:58.048 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/37 file after the snapshot 2024-08-31T12:15:58.049 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/38 file after the snapshot 2024-08-31T12:15:58.050 INFO:tasks.workunit.client.0.smithi164.stdout: create 141/39 file after the snapshot 2024-08-31T12:15:58.051 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/.snap/snap-subdir-test 2024-08-31T12:15:58.071 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/30 file after the snapshot 2024-08-31T12:15:58.072 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/31 file after the snapshot 2024-08-31T12:15:58.073 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/32 file after the snapshot 2024-08-31T12:15:58.074 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/33 file after the snapshot 2024-08-31T12:15:58.075 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/34 file after the snapshot 2024-08-31T12:15:58.076 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/35 file after the snapshot 2024-08-31T12:15:58.077 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/36 file after the snapshot 2024-08-31T12:15:58.078 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/37 file after the snapshot 2024-08-31T12:15:58.082 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/38 file after the snapshot 2024-08-31T12:15:58.091 INFO:tasks.workunit.client.0.smithi164.stdout: create 142/39 file after the snapshot 2024-08-31T12:15:58.093 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/.snap/snap-subdir-test 2024-08-31T12:15:58.113 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/30 file after the snapshot 2024-08-31T12:15:58.114 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/31 file after the snapshot 2024-08-31T12:15:58.115 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/32 file after the snapshot 2024-08-31T12:15:58.116 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/33 file after the snapshot 2024-08-31T12:15:58.117 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/34 file after the snapshot 2024-08-31T12:15:58.118 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/35 file after the snapshot 2024-08-31T12:15:58.120 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/36 file after the snapshot 2024-08-31T12:15:58.124 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/37 file after the snapshot 2024-08-31T12:15:58.129 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/38 file after the snapshot 2024-08-31T12:15:58.134 INFO:tasks.workunit.client.0.smithi164.stdout: create 143/39 file after the snapshot 2024-08-31T12:15:58.135 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/.snap/snap-subdir-test 2024-08-31T12:15:58.153 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/30 file after the snapshot 2024-08-31T12:15:58.155 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/31 file after the snapshot 2024-08-31T12:15:58.157 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/32 file after the snapshot 2024-08-31T12:15:58.158 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/33 file after the snapshot 2024-08-31T12:15:58.159 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/34 file after the snapshot 2024-08-31T12:15:58.160 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/35 file after the snapshot 2024-08-31T12:15:58.161 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/36 file after the snapshot 2024-08-31T12:15:58.162 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/37 file after the snapshot 2024-08-31T12:15:58.165 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/38 file after the snapshot 2024-08-31T12:15:58.170 INFO:tasks.workunit.client.0.smithi164.stdout: create 144/39 file after the snapshot 2024-08-31T12:15:58.436 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/.snap/snap-subdir-test 2024-08-31T12:15:59.433 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/30 file after the snapshot 2024-08-31T12:15:59.434 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/31 file after the snapshot 2024-08-31T12:15:59.435 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/32 file after the snapshot 2024-08-31T12:15:59.437 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/33 file after the snapshot 2024-08-31T12:15:59.438 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/34 file after the snapshot 2024-08-31T12:15:59.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/35 file after the snapshot 2024-08-31T12:15:59.456 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/36 file after the snapshot 2024-08-31T12:15:59.461 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/37 file after the snapshot 2024-08-31T12:15:59.462 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/38 file after the snapshot 2024-08-31T12:15:59.464 INFO:tasks.workunit.client.0.smithi164.stdout: create 145/39 file after the snapshot 2024-08-31T12:15:59.466 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/.snap/snap-subdir-test 2024-08-31T12:15:59.490 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/30 file after the snapshot 2024-08-31T12:15:59.492 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/31 file after the snapshot 2024-08-31T12:15:59.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/32 file after the snapshot 2024-08-31T12:15:59.500 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/33 file after the snapshot 2024-08-31T12:15:59.508 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/34 file after the snapshot 2024-08-31T12:15:59.510 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/35 file after the snapshot 2024-08-31T12:15:59.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/36 file after the snapshot 2024-08-31T12:15:59.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/37 file after the snapshot 2024-08-31T12:15:59.513 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/38 file after the snapshot 2024-08-31T12:15:59.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 146/39 file after the snapshot 2024-08-31T12:15:59.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/.snap/snap-subdir-test 2024-08-31T12:15:59.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/30 file after the snapshot 2024-08-31T12:15:59.538 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/31 file after the snapshot 2024-08-31T12:15:59.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/32 file after the snapshot 2024-08-31T12:15:59.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/33 file after the snapshot 2024-08-31T12:15:59.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/34 file after the snapshot 2024-08-31T12:15:59.545 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/35 file after the snapshot 2024-08-31T12:15:59.553 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/36 file after the snapshot 2024-08-31T12:15:59.558 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/37 file after the snapshot 2024-08-31T12:15:59.559 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/38 file after the snapshot 2024-08-31T12:15:59.561 INFO:tasks.workunit.client.0.smithi164.stdout: create 147/39 file after the snapshot 2024-08-31T12:15:59.561 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/.snap/snap-subdir-test 2024-08-31T12:15:59.582 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/30 file after the snapshot 2024-08-31T12:15:59.584 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/31 file after the snapshot 2024-08-31T12:15:59.585 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/32 file after the snapshot 2024-08-31T12:15:59.586 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/33 file after the snapshot 2024-08-31T12:15:59.588 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/34 file after the snapshot 2024-08-31T12:15:59.590 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/35 file after the snapshot 2024-08-31T12:15:59.595 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/36 file after the snapshot 2024-08-31T12:15:59.601 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/37 file after the snapshot 2024-08-31T12:15:59.602 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/38 file after the snapshot 2024-08-31T12:15:59.603 INFO:tasks.workunit.client.0.smithi164.stdout: create 148/39 file after the snapshot 2024-08-31T12:15:59.604 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/.snap/snap-subdir-test 2024-08-31T12:15:59.627 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/30 file after the snapshot 2024-08-31T12:15:59.629 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/31 file after the snapshot 2024-08-31T12:15:59.632 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/32 file after the snapshot 2024-08-31T12:15:59.640 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/33 file after the snapshot 2024-08-31T12:15:59.645 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/34 file after the snapshot 2024-08-31T12:15:59.646 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/35 file after the snapshot 2024-08-31T12:15:59.647 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/36 file after the snapshot 2024-08-31T12:15:59.901 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/37 file after the snapshot 2024-08-31T12:15:59.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/38 file after the snapshot 2024-08-31T12:15:59.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 149/39 file after the snapshot 2024-08-31T12:15:59.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/.snap/snap-subdir-test 2024-08-31T12:15:59.934 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/30 file after the snapshot 2024-08-31T12:15:59.936 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/31 file after the snapshot 2024-08-31T12:15:59.937 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/32 file after the snapshot 2024-08-31T12:15:59.938 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/33 file after the snapshot 2024-08-31T12:15:59.941 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/34 file after the snapshot 2024-08-31T12:15:59.950 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/35 file after the snapshot 2024-08-31T12:16:00.459 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/36 file after the snapshot 2024-08-31T12:16:00.705 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/37 file after the snapshot 2024-08-31T12:16:00.706 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/38 file after the snapshot 2024-08-31T12:16:00.708 INFO:tasks.workunit.client.0.smithi164.stdout: create 150/39 file after the snapshot 2024-08-31T12:16:00.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/.snap/snap-subdir-test 2024-08-31T12:16:00.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/30 file after the snapshot 2024-08-31T12:16:00.737 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/31 file after the snapshot 2024-08-31T12:16:00.739 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/32 file after the snapshot 2024-08-31T12:16:00.742 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/33 file after the snapshot 2024-08-31T12:16:00.748 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/34 file after the snapshot 2024-08-31T12:16:00.766 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/35 file after the snapshot 2024-08-31T12:16:00.778 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/36 file after the snapshot 2024-08-31T12:16:00.779 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/37 file after the snapshot 2024-08-31T12:16:00.780 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/38 file after the snapshot 2024-08-31T12:16:00.781 INFO:tasks.workunit.client.0.smithi164.stdout: create 151/39 file after the snapshot 2024-08-31T12:16:00.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/.snap/snap-subdir-test 2024-08-31T12:16:00.805 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/30 file after the snapshot 2024-08-31T12:16:00.807 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/31 file after the snapshot 2024-08-31T12:16:00.808 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/32 file after the snapshot 2024-08-31T12:16:00.811 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/33 file after the snapshot 2024-08-31T12:16:00.812 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/34 file after the snapshot 2024-08-31T12:16:00.815 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/35 file after the snapshot 2024-08-31T12:16:00.823 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/36 file after the snapshot 2024-08-31T12:16:00.825 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/37 file after the snapshot 2024-08-31T12:16:00.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/38 file after the snapshot 2024-08-31T12:16:00.827 INFO:tasks.workunit.client.0.smithi164.stdout: create 152/39 file after the snapshot 2024-08-31T12:16:00.828 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/.snap/snap-subdir-test 2024-08-31T12:16:00.865 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/30 file after the snapshot 2024-08-31T12:16:00.867 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/31 file after the snapshot 2024-08-31T12:16:00.868 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/32 file after the snapshot 2024-08-31T12:16:00.870 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/33 file after the snapshot 2024-08-31T12:16:00.871 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/34 file after the snapshot 2024-08-31T12:16:00.872 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/35 file after the snapshot 2024-08-31T12:16:00.873 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/36 file after the snapshot 2024-08-31T12:16:00.874 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/37 file after the snapshot 2024-08-31T12:16:00.875 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/38 file after the snapshot 2024-08-31T12:16:00.878 INFO:tasks.workunit.client.0.smithi164.stdout: create 153/39 file after the snapshot 2024-08-31T12:16:00.883 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/.snap/snap-subdir-test 2024-08-31T12:16:01.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/30 file after the snapshot 2024-08-31T12:16:01.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/31 file after the snapshot 2024-08-31T12:16:01.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/32 file after the snapshot 2024-08-31T12:16:01.713 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/33 file after the snapshot 2024-08-31T12:16:01.716 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/34 file after the snapshot 2024-08-31T12:16:01.722 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/35 file after the snapshot 2024-08-31T12:16:01.727 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/36 file after the snapshot 2024-08-31T12:16:01.728 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/37 file after the snapshot 2024-08-31T12:16:01.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/38 file after the snapshot 2024-08-31T12:16:01.730 INFO:tasks.workunit.client.0.smithi164.stdout: create 154/39 file after the snapshot 2024-08-31T12:16:01.731 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/.snap/snap-subdir-test 2024-08-31T12:16:01.763 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/30 file after the snapshot 2024-08-31T12:16:01.764 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/31 file after the snapshot 2024-08-31T12:16:01.765 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/32 file after the snapshot 2024-08-31T12:16:01.767 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/33 file after the snapshot 2024-08-31T12:16:01.768 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/34 file after the snapshot 2024-08-31T12:16:01.770 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/35 file after the snapshot 2024-08-31T12:16:01.772 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/36 file after the snapshot 2024-08-31T12:16:01.776 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/37 file after the snapshot 2024-08-31T12:16:01.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/38 file after the snapshot 2024-08-31T12:16:01.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 155/39 file after the snapshot 2024-08-31T12:16:01.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/.snap/snap-subdir-test 2024-08-31T12:16:01.807 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/30 file after the snapshot 2024-08-31T12:16:01.809 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/31 file after the snapshot 2024-08-31T12:16:01.810 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/32 file after the snapshot 2024-08-31T12:16:01.811 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/33 file after the snapshot 2024-08-31T12:16:01.813 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/34 file after the snapshot 2024-08-31T12:16:01.817 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/35 file after the snapshot 2024-08-31T12:16:01.821 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/36 file after the snapshot 2024-08-31T12:16:01.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/37 file after the snapshot 2024-08-31T12:16:01.828 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/38 file after the snapshot 2024-08-31T12:16:01.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 156/39 file after the snapshot 2024-08-31T12:16:01.830 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/.snap/snap-subdir-test 2024-08-31T12:16:01.855 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/30 file after the snapshot 2024-08-31T12:16:01.857 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/31 file after the snapshot 2024-08-31T12:16:01.858 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/32 file after the snapshot 2024-08-31T12:16:01.859 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/33 file after the snapshot 2024-08-31T12:16:01.861 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/34 file after the snapshot 2024-08-31T12:16:01.863 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/35 file after the snapshot 2024-08-31T12:16:01.867 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/36 file after the snapshot 2024-08-31T12:16:01.875 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/37 file after the snapshot 2024-08-31T12:16:01.876 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/38 file after the snapshot 2024-08-31T12:16:01.877 INFO:tasks.workunit.client.0.smithi164.stdout: create 157/39 file after the snapshot 2024-08-31T12:16:01.879 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/.snap/snap-subdir-test 2024-08-31T12:16:01.903 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/30 file after the snapshot 2024-08-31T12:16:01.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/31 file after the snapshot 2024-08-31T12:16:01.906 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/32 file after the snapshot 2024-08-31T12:16:01.908 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/33 file after the snapshot 2024-08-31T12:16:01.912 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/34 file after the snapshot 2024-08-31T12:16:01.924 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/35 file after the snapshot 2024-08-31T12:16:01.929 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/36 file after the snapshot 2024-08-31T12:16:01.930 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/37 file after the snapshot 2024-08-31T12:16:01.931 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/38 file after the snapshot 2024-08-31T12:16:01.933 INFO:tasks.workunit.client.0.smithi164.stdout: create 158/39 file after the snapshot 2024-08-31T12:16:01.934 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/.snap/snap-subdir-test 2024-08-31T12:16:01.960 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/30 file after the snapshot 2024-08-31T12:16:01.961 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/31 file after the snapshot 2024-08-31T12:16:01.962 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/32 file after the snapshot 2024-08-31T12:16:01.963 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/33 file after the snapshot 2024-08-31T12:16:01.964 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/34 file after the snapshot 2024-08-31T12:16:01.968 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/35 file after the snapshot 2024-08-31T12:16:01.974 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/36 file after the snapshot 2024-08-31T12:16:02.435 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/37 file after the snapshot 2024-08-31T12:16:02.484 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/38 file after the snapshot 2024-08-31T12:16:02.485 INFO:tasks.workunit.client.0.smithi164.stdout: create 159/39 file after the snapshot 2024-08-31T12:16:02.486 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/.snap/snap-subdir-test 2024-08-31T12:16:02.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/30 file after the snapshot 2024-08-31T12:16:02.513 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/31 file after the snapshot 2024-08-31T12:16:02.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/32 file after the snapshot 2024-08-31T12:16:02.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/33 file after the snapshot 2024-08-31T12:16:02.517 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/34 file after the snapshot 2024-08-31T12:16:02.523 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/35 file after the snapshot 2024-08-31T12:16:02.528 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/36 file after the snapshot 2024-08-31T12:16:02.529 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/37 file after the snapshot 2024-08-31T12:16:02.531 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/38 file after the snapshot 2024-08-31T12:16:02.532 INFO:tasks.workunit.client.0.smithi164.stdout: create 160/39 file after the snapshot 2024-08-31T12:16:02.533 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/.snap/snap-subdir-test 2024-08-31T12:16:02.562 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/30 file after the snapshot 2024-08-31T12:16:02.562 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/31 file after the snapshot 2024-08-31T12:16:02.562 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/32 file after the snapshot 2024-08-31T12:16:02.568 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/33 file after the snapshot 2024-08-31T12:16:02.575 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/34 file after the snapshot 2024-08-31T12:16:02.576 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/35 file after the snapshot 2024-08-31T12:16:02.577 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/36 file after the snapshot 2024-08-31T12:16:02.578 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/37 file after the snapshot 2024-08-31T12:16:02.579 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/38 file after the snapshot 2024-08-31T12:16:02.580 INFO:tasks.workunit.client.0.smithi164.stdout: create 161/39 file after the snapshot 2024-08-31T12:16:02.581 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/.snap/snap-subdir-test 2024-08-31T12:16:02.608 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/30 file after the snapshot 2024-08-31T12:16:02.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/31 file after the snapshot 2024-08-31T12:16:02.612 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/32 file after the snapshot 2024-08-31T12:16:02.614 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/33 file after the snapshot 2024-08-31T12:16:02.618 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/34 file after the snapshot 2024-08-31T12:16:02.622 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/35 file after the snapshot 2024-08-31T12:16:02.627 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/36 file after the snapshot 2024-08-31T12:16:02.628 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/37 file after the snapshot 2024-08-31T12:16:02.629 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/38 file after the snapshot 2024-08-31T12:16:02.630 INFO:tasks.workunit.client.0.smithi164.stdout: create 162/39 file after the snapshot 2024-08-31T12:16:02.631 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/.snap/snap-subdir-test 2024-08-31T12:16:02.673 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/30 file after the snapshot 2024-08-31T12:16:02.680 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/31 file after the snapshot 2024-08-31T12:16:02.687 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/32 file after the snapshot 2024-08-31T12:16:02.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/33 file after the snapshot 2024-08-31T12:16:02.689 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/34 file after the snapshot 2024-08-31T12:16:02.690 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/35 file after the snapshot 2024-08-31T12:16:02.691 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/36 file after the snapshot 2024-08-31T12:16:02.692 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/37 file after the snapshot 2024-08-31T12:16:02.693 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/38 file after the snapshot 2024-08-31T12:16:02.694 INFO:tasks.workunit.client.0.smithi164.stdout: create 163/39 file after the snapshot 2024-08-31T12:16:02.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/.snap/snap-subdir-test 2024-08-31T12:16:02.726 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/30 file after the snapshot 2024-08-31T12:16:02.727 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/31 file after the snapshot 2024-08-31T12:16:02.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/32 file after the snapshot 2024-08-31T12:16:02.730 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/33 file after the snapshot 2024-08-31T12:16:02.732 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/34 file after the snapshot 2024-08-31T12:16:02.733 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/35 file after the snapshot 2024-08-31T12:16:02.736 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/36 file after the snapshot 2024-08-31T12:16:02.743 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/37 file after the snapshot 2024-08-31T12:16:02.754 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/38 file after the snapshot 2024-08-31T12:16:02.755 INFO:tasks.workunit.client.0.smithi164.stdout: create 164/39 file after the snapshot 2024-08-31T12:16:02.756 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/.snap/snap-subdir-test 2024-08-31T12:16:02.773 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/30 file after the snapshot 2024-08-31T12:16:02.774 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/31 file after the snapshot 2024-08-31T12:16:02.775 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/32 file after the snapshot 2024-08-31T12:16:02.776 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/33 file after the snapshot 2024-08-31T12:16:02.778 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/34 file after the snapshot 2024-08-31T12:16:02.779 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/35 file after the snapshot 2024-08-31T12:16:02.781 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/36 file after the snapshot 2024-08-31T12:16:02.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/37 file after the snapshot 2024-08-31T12:16:02.790 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/38 file after the snapshot 2024-08-31T12:16:03.322 INFO:tasks.workunit.client.0.smithi164.stdout: create 165/39 file after the snapshot 2024-08-31T12:16:03.323 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/.snap/snap-subdir-test 2024-08-31T12:16:03.433 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/30 file after the snapshot 2024-08-31T12:16:03.436 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/31 file after the snapshot 2024-08-31T12:16:03.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/32 file after the snapshot 2024-08-31T12:16:03.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/33 file after the snapshot 2024-08-31T12:16:03.452 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/34 file after the snapshot 2024-08-31T12:16:03.453 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/35 file after the snapshot 2024-08-31T12:16:03.454 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/36 file after the snapshot 2024-08-31T12:16:03.541 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:16:03.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:16:03.708 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/37 file after the snapshot 2024-08-31T12:16:03.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/38 file after the snapshot 2024-08-31T12:16:03.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 166/39 file after the snapshot 2024-08-31T12:16:03.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/.snap/snap-subdir-test 2024-08-31T12:16:03.922 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/30 file after the snapshot 2024-08-31T12:16:03.923 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/31 file after the snapshot 2024-08-31T12:16:03.925 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/32 file after the snapshot 2024-08-31T12:16:03.926 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/33 file after the snapshot 2024-08-31T12:16:03.932 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/34 file after the snapshot 2024-08-31T12:16:03.939 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/35 file after the snapshot 2024-08-31T12:16:03.945 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/36 file after the snapshot 2024-08-31T12:16:03.946 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/37 file after the snapshot 2024-08-31T12:16:03.947 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/38 file after the snapshot 2024-08-31T12:16:03.948 INFO:tasks.workunit.client.0.smithi164.stdout: create 167/39 file after the snapshot 2024-08-31T12:16:03.949 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/.snap/snap-subdir-test 2024-08-31T12:16:03.977 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/30 file after the snapshot 2024-08-31T12:16:03.982 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/31 file after the snapshot 2024-08-31T12:16:03.986 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/32 file after the snapshot 2024-08-31T12:16:03.994 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/33 file after the snapshot 2024-08-31T12:16:03.995 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/34 file after the snapshot 2024-08-31T12:16:03.996 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/35 file after the snapshot 2024-08-31T12:16:03.997 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/36 file after the snapshot 2024-08-31T12:16:03.998 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/37 file after the snapshot 2024-08-31T12:16:03.999 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/38 file after the snapshot 2024-08-31T12:16:04.000 INFO:tasks.workunit.client.0.smithi164.stdout: create 168/39 file after the snapshot 2024-08-31T12:16:04.001 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/.snap/snap-subdir-test 2024-08-31T12:16:04.032 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/30 file after the snapshot 2024-08-31T12:16:04.034 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/31 file after the snapshot 2024-08-31T12:16:04.035 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/32 file after the snapshot 2024-08-31T12:16:04.037 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/33 file after the snapshot 2024-08-31T12:16:04.038 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/34 file after the snapshot 2024-08-31T12:16:04.041 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/35 file after the snapshot 2024-08-31T12:16:04.046 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/36 file after the snapshot 2024-08-31T12:16:04.330 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/37 file after the snapshot 2024-08-31T12:16:04.331 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/38 file after the snapshot 2024-08-31T12:16:04.332 INFO:tasks.workunit.client.0.smithi164.stdout: create 169/39 file after the snapshot 2024-08-31T12:16:04.333 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/.snap/snap-subdir-test 2024-08-31T12:16:04.359 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/30 file after the snapshot 2024-08-31T12:16:04.360 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/31 file after the snapshot 2024-08-31T12:16:04.362 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/32 file after the snapshot 2024-08-31T12:16:04.363 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/33 file after the snapshot 2024-08-31T12:16:04.364 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/34 file after the snapshot 2024-08-31T12:16:04.365 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/35 file after the snapshot 2024-08-31T12:16:04.371 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/36 file after the snapshot 2024-08-31T12:16:04.380 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/37 file after the snapshot 2024-08-31T12:16:04.384 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/38 file after the snapshot 2024-08-31T12:16:04.386 INFO:tasks.workunit.client.0.smithi164.stdout: create 170/39 file after the snapshot 2024-08-31T12:16:04.387 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/.snap/snap-subdir-test 2024-08-31T12:16:04.411 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/30 file after the snapshot 2024-08-31T12:16:04.412 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/31 file after the snapshot 2024-08-31T12:16:04.414 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/32 file after the snapshot 2024-08-31T12:16:04.415 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/33 file after the snapshot 2024-08-31T12:16:04.416 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/34 file after the snapshot 2024-08-31T12:16:04.417 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/35 file after the snapshot 2024-08-31T12:16:04.419 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/36 file after the snapshot 2024-08-31T12:16:04.427 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/37 file after the snapshot 2024-08-31T12:16:04.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/38 file after the snapshot 2024-08-31T12:16:04.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 171/39 file after the snapshot 2024-08-31T12:16:04.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/.snap/snap-subdir-test 2024-08-31T12:16:04.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/30 file after the snapshot 2024-08-31T12:16:04.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/31 file after the snapshot 2024-08-31T12:16:04.456 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/32 file after the snapshot 2024-08-31T12:16:04.457 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/33 file after the snapshot 2024-08-31T12:16:04.459 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/34 file after the snapshot 2024-08-31T12:16:04.460 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/35 file after the snapshot 2024-08-31T12:16:04.461 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/36 file after the snapshot 2024-08-31T12:16:04.463 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/37 file after the snapshot 2024-08-31T12:16:04.465 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/38 file after the snapshot 2024-08-31T12:16:04.467 INFO:tasks.workunit.client.0.smithi164.stdout: create 172/39 file after the snapshot 2024-08-31T12:16:04.470 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/.snap/snap-subdir-test 2024-08-31T12:16:04.496 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/30 file after the snapshot 2024-08-31T12:16:04.498 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/31 file after the snapshot 2024-08-31T12:16:04.499 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/32 file after the snapshot 2024-08-31T12:16:04.503 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/33 file after the snapshot 2024-08-31T12:16:04.510 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/34 file after the snapshot 2024-08-31T12:16:04.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/35 file after the snapshot 2024-08-31T12:16:04.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/36 file after the snapshot 2024-08-31T12:16:04.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/37 file after the snapshot 2024-08-31T12:16:04.517 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/38 file after the snapshot 2024-08-31T12:16:04.518 INFO:tasks.workunit.client.0.smithi164.stdout: create 173/39 file after the snapshot 2024-08-31T12:16:04.519 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/.snap/snap-subdir-test 2024-08-31T12:16:04.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/30 file after the snapshot 2024-08-31T12:16:04.543 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/31 file after the snapshot 2024-08-31T12:16:04.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/32 file after the snapshot 2024-08-31T12:16:04.545 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/33 file after the snapshot 2024-08-31T12:16:04.547 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/34 file after the snapshot 2024-08-31T12:16:04.548 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/35 file after the snapshot 2024-08-31T12:16:04.549 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/36 file after the snapshot 2024-08-31T12:16:04.555 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/37 file after the snapshot 2024-08-31T12:16:05.036 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/38 file after the snapshot 2024-08-31T12:16:05.037 INFO:tasks.workunit.client.0.smithi164.stdout: create 174/39 file after the snapshot 2024-08-31T12:16:05.038 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/.snap/snap-subdir-test 2024-08-31T12:16:05.063 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/30 file after the snapshot 2024-08-31T12:16:05.064 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/31 file after the snapshot 2024-08-31T12:16:05.068 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/32 file after the snapshot 2024-08-31T12:16:05.075 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/33 file after the snapshot 2024-08-31T12:16:05.284 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/34 file after the snapshot 2024-08-31T12:16:05.285 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/35 file after the snapshot 2024-08-31T12:16:05.286 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/36 file after the snapshot 2024-08-31T12:16:05.287 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/37 file after the snapshot 2024-08-31T12:16:05.288 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/38 file after the snapshot 2024-08-31T12:16:05.289 INFO:tasks.workunit.client.0.smithi164.stdout: create 175/39 file after the snapshot 2024-08-31T12:16:05.290 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/.snap/snap-subdir-test 2024-08-31T12:16:05.316 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/30 file after the snapshot 2024-08-31T12:16:05.318 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/31 file after the snapshot 2024-08-31T12:16:05.320 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/32 file after the snapshot 2024-08-31T12:16:05.321 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/33 file after the snapshot 2024-08-31T12:16:05.323 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/34 file after the snapshot 2024-08-31T12:16:05.328 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/35 file after the snapshot 2024-08-31T12:16:05.338 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/36 file after the snapshot 2024-08-31T12:16:05.339 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/37 file after the snapshot 2024-08-31T12:16:05.340 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/38 file after the snapshot 2024-08-31T12:16:05.341 INFO:tasks.workunit.client.0.smithi164.stdout: create 176/39 file after the snapshot 2024-08-31T12:16:05.342 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/.snap/snap-subdir-test 2024-08-31T12:16:05.366 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/30 file after the snapshot 2024-08-31T12:16:05.368 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/31 file after the snapshot 2024-08-31T12:16:05.371 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/32 file after the snapshot 2024-08-31T12:16:05.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/33 file after the snapshot 2024-08-31T12:16:05.375 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/34 file after the snapshot 2024-08-31T12:16:05.380 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/35 file after the snapshot 2024-08-31T12:16:05.386 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/36 file after the snapshot 2024-08-31T12:16:05.387 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/37 file after the snapshot 2024-08-31T12:16:05.389 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/38 file after the snapshot 2024-08-31T12:16:05.390 INFO:tasks.workunit.client.0.smithi164.stdout: create 177/39 file after the snapshot 2024-08-31T12:16:05.392 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/.snap/snap-subdir-test 2024-08-31T12:16:05.449 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/30 file after the snapshot 2024-08-31T12:16:05.450 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/31 file after the snapshot 2024-08-31T12:16:05.451 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/32 file after the snapshot 2024-08-31T12:16:05.453 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/33 file after the snapshot 2024-08-31T12:16:05.457 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/34 file after the snapshot 2024-08-31T12:16:05.464 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/35 file after the snapshot 2024-08-31T12:16:05.468 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/36 file after the snapshot 2024-08-31T12:16:05.469 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/37 file after the snapshot 2024-08-31T12:16:05.470 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/38 file after the snapshot 2024-08-31T12:16:05.471 INFO:tasks.workunit.client.0.smithi164.stdout: create 178/39 file after the snapshot 2024-08-31T12:16:05.472 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/.snap/snap-subdir-test 2024-08-31T12:16:05.494 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/30 file after the snapshot 2024-08-31T12:16:05.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/31 file after the snapshot 2024-08-31T12:16:05.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/32 file after the snapshot 2024-08-31T12:16:05.498 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/33 file after the snapshot 2024-08-31T12:16:05.502 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/34 file after the snapshot 2024-08-31T12:16:05.509 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/35 file after the snapshot 2024-08-31T12:16:05.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/36 file after the snapshot 2024-08-31T12:16:05.513 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/37 file after the snapshot 2024-08-31T12:16:05.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/38 file after the snapshot 2024-08-31T12:16:05.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 179/39 file after the snapshot 2024-08-31T12:16:05.517 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/.snap/snap-subdir-test 2024-08-31T12:16:05.548 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/30 file after the snapshot 2024-08-31T12:16:05.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/31 file after the snapshot 2024-08-31T12:16:05.553 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/32 file after the snapshot 2024-08-31T12:16:05.557 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/33 file after the snapshot 2024-08-31T12:16:05.562 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/34 file after the snapshot 2024-08-31T12:16:05.566 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/35 file after the snapshot 2024-08-31T12:16:05.566 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/36 file after the snapshot 2024-08-31T12:16:05.567 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/37 file after the snapshot 2024-08-31T12:16:05.568 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/38 file after the snapshot 2024-08-31T12:16:05.569 INFO:tasks.workunit.client.0.smithi164.stdout: create 180/39 file after the snapshot 2024-08-31T12:16:05.570 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/.snap/snap-subdir-test 2024-08-31T12:16:05.594 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/30 file after the snapshot 2024-08-31T12:16:05.596 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/31 file after the snapshot 2024-08-31T12:16:05.598 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/32 file after the snapshot 2024-08-31T12:16:05.601 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/33 file after the snapshot 2024-08-31T12:16:05.607 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/34 file after the snapshot 2024-08-31T12:16:05.611 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/35 file after the snapshot 2024-08-31T12:16:05.612 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/36 file after the snapshot 2024-08-31T12:16:05.612 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/37 file after the snapshot 2024-08-31T12:16:05.613 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/38 file after the snapshot 2024-08-31T12:16:05.614 INFO:tasks.workunit.client.0.smithi164.stdout: create 181/39 file after the snapshot 2024-08-31T12:16:05.615 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/.snap/snap-subdir-test 2024-08-31T12:16:05.637 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/30 file after the snapshot 2024-08-31T12:16:05.638 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/31 file after the snapshot 2024-08-31T12:16:05.640 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/32 file after the snapshot 2024-08-31T12:16:05.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/33 file after the snapshot 2024-08-31T12:16:05.643 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/34 file after the snapshot 2024-08-31T12:16:05.645 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/35 file after the snapshot 2024-08-31T12:16:05.650 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/36 file after the snapshot 2024-08-31T12:16:05.656 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/37 file after the snapshot 2024-08-31T12:16:05.657 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/38 file after the snapshot 2024-08-31T12:16:05.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 182/39 file after the snapshot 2024-08-31T12:16:05.659 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/.snap/snap-subdir-test 2024-08-31T12:16:05.679 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/30 file after the snapshot 2024-08-31T12:16:05.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/31 file after the snapshot 2024-08-31T12:16:05.682 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/32 file after the snapshot 2024-08-31T12:16:05.685 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/33 file after the snapshot 2024-08-31T12:16:05.693 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/34 file after the snapshot 2024-08-31T12:16:05.697 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/35 file after the snapshot 2024-08-31T12:16:05.698 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/36 file after the snapshot 2024-08-31T12:16:05.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/37 file after the snapshot 2024-08-31T12:16:05.701 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/38 file after the snapshot 2024-08-31T12:16:05.705 INFO:tasks.workunit.client.0.smithi164.stdout: create 183/39 file after the snapshot 2024-08-31T12:16:05.706 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/.snap/snap-subdir-test 2024-08-31T12:16:05.727 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/30 file after the snapshot 2024-08-31T12:16:05.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/31 file after the snapshot 2024-08-31T12:16:05.731 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/32 file after the snapshot 2024-08-31T12:16:05.736 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/33 file after the snapshot 2024-08-31T12:16:05.746 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/34 file after the snapshot 2024-08-31T12:16:05.799 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/35 file after the snapshot 2024-08-31T12:16:05.799 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/36 file after the snapshot 2024-08-31T12:16:05.800 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/37 file after the snapshot 2024-08-31T12:16:05.801 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/38 file after the snapshot 2024-08-31T12:16:05.802 INFO:tasks.workunit.client.0.smithi164.stdout: create 184/39 file after the snapshot 2024-08-31T12:16:05.804 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/.snap/snap-subdir-test 2024-08-31T12:16:05.825 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/30 file after the snapshot 2024-08-31T12:16:05.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/31 file after the snapshot 2024-08-31T12:16:05.828 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/32 file after the snapshot 2024-08-31T12:16:05.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/33 file after the snapshot 2024-08-31T12:16:05.830 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/34 file after the snapshot 2024-08-31T12:16:05.833 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/35 file after the snapshot 2024-08-31T12:16:05.840 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/36 file after the snapshot 2024-08-31T12:16:05.845 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/37 file after the snapshot 2024-08-31T12:16:05.846 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/38 file after the snapshot 2024-08-31T12:16:05.847 INFO:tasks.workunit.client.0.smithi164.stdout: create 185/39 file after the snapshot 2024-08-31T12:16:05.847 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/.snap/snap-subdir-test 2024-08-31T12:16:05.868 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/30 file after the snapshot 2024-08-31T12:16:05.870 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/31 file after the snapshot 2024-08-31T12:16:05.871 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/32 file after the snapshot 2024-08-31T12:16:05.872 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/33 file after the snapshot 2024-08-31T12:16:05.878 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/34 file after the snapshot 2024-08-31T12:16:05.887 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/35 file after the snapshot 2024-08-31T12:16:06.500 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/36 file after the snapshot 2024-08-31T12:16:06.839 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/37 file after the snapshot 2024-08-31T12:16:06.840 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/38 file after the snapshot 2024-08-31T12:16:06.842 INFO:tasks.workunit.client.0.smithi164.stdout: create 186/39 file after the snapshot 2024-08-31T12:16:06.843 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/.snap/snap-subdir-test 2024-08-31T12:16:06.868 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/30 file after the snapshot 2024-08-31T12:16:06.871 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/31 file after the snapshot 2024-08-31T12:16:06.877 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/32 file after the snapshot 2024-08-31T12:16:06.885 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/33 file after the snapshot 2024-08-31T12:16:06.885 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/34 file after the snapshot 2024-08-31T12:16:06.886 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/35 file after the snapshot 2024-08-31T12:16:06.887 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/36 file after the snapshot 2024-08-31T12:16:06.888 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/37 file after the snapshot 2024-08-31T12:16:06.889 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/38 file after the snapshot 2024-08-31T12:16:06.890 INFO:tasks.workunit.client.0.smithi164.stdout: create 187/39 file after the snapshot 2024-08-31T12:16:06.891 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/.snap/snap-subdir-test 2024-08-31T12:16:06.912 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/30 file after the snapshot 2024-08-31T12:16:06.914 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/31 file after the snapshot 2024-08-31T12:16:06.916 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/32 file after the snapshot 2024-08-31T12:16:06.917 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/33 file after the snapshot 2024-08-31T12:16:07.168 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/34 file after the snapshot 2024-08-31T12:16:07.176 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/35 file after the snapshot 2024-08-31T12:16:07.177 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/36 file after the snapshot 2024-08-31T12:16:07.178 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/37 file after the snapshot 2024-08-31T12:16:07.179 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/38 file after the snapshot 2024-08-31T12:16:07.180 INFO:tasks.workunit.client.0.smithi164.stdout: create 188/39 file after the snapshot 2024-08-31T12:16:07.181 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/.snap/snap-subdir-test 2024-08-31T12:16:07.203 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/30 file after the snapshot 2024-08-31T12:16:07.205 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/31 file after the snapshot 2024-08-31T12:16:07.206 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/32 file after the snapshot 2024-08-31T12:16:07.208 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/33 file after the snapshot 2024-08-31T12:16:07.212 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/34 file after the snapshot 2024-08-31T12:16:07.219 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/35 file after the snapshot 2024-08-31T12:16:07.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/36 file after the snapshot 2024-08-31T12:16:07.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/37 file after the snapshot 2024-08-31T12:16:07.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/38 file after the snapshot 2024-08-31T12:16:07.786 INFO:tasks.workunit.client.0.smithi164.stdout: create 189/39 file after the snapshot 2024-08-31T12:16:07.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/.snap/snap-subdir-test 2024-08-31T12:16:07.802 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/30 file after the snapshot 2024-08-31T12:16:07.804 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/31 file after the snapshot 2024-08-31T12:16:07.805 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/32 file after the snapshot 2024-08-31T12:16:07.806 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/33 file after the snapshot 2024-08-31T12:16:07.809 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/34 file after the snapshot 2024-08-31T12:16:07.810 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/35 file after the snapshot 2024-08-31T12:16:07.818 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/36 file after the snapshot 2024-08-31T12:16:08.140 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/37 file after the snapshot 2024-08-31T12:16:08.141 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/38 file after the snapshot 2024-08-31T12:16:08.142 INFO:tasks.workunit.client.0.smithi164.stdout: create 190/39 file after the snapshot 2024-08-31T12:16:08.143 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/.snap/snap-subdir-test 2024-08-31T12:16:08.168 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/30 file after the snapshot 2024-08-31T12:16:08.170 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/31 file after the snapshot 2024-08-31T12:16:08.171 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/32 file after the snapshot 2024-08-31T12:16:08.173 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/33 file after the snapshot 2024-08-31T12:16:08.174 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/34 file after the snapshot 2024-08-31T12:16:08.177 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/35 file after the snapshot 2024-08-31T12:16:08.184 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/36 file after the snapshot 2024-08-31T12:16:08.484 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/37 file after the snapshot 2024-08-31T12:16:08.849 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/38 file after the snapshot 2024-08-31T12:16:08.850 INFO:tasks.workunit.client.0.smithi164.stdout: create 191/39 file after the snapshot 2024-08-31T12:16:08.851 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/.snap/snap-subdir-test 2024-08-31T12:16:09.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/30 file after the snapshot 2024-08-31T12:16:09.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/31 file after the snapshot 2024-08-31T12:16:09.521 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/32 file after the snapshot 2024-08-31T12:16:09.533 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/33 file after the snapshot 2024-08-31T12:16:09.672 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/34 file after the snapshot 2024-08-31T12:16:09.673 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/35 file after the snapshot 2024-08-31T12:16:09.674 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/36 file after the snapshot 2024-08-31T12:16:09.676 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/37 file after the snapshot 2024-08-31T12:16:09.677 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/38 file after the snapshot 2024-08-31T12:16:09.678 INFO:tasks.workunit.client.0.smithi164.stdout: create 192/39 file after the snapshot 2024-08-31T12:16:09.679 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/.snap/snap-subdir-test 2024-08-31T12:16:09.714 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/30 file after the snapshot 2024-08-31T12:16:09.715 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/31 file after the snapshot 2024-08-31T12:16:09.717 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/32 file after the snapshot 2024-08-31T12:16:09.721 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/33 file after the snapshot 2024-08-31T12:16:09.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/34 file after the snapshot 2024-08-31T12:16:09.732 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/35 file after the snapshot 2024-08-31T12:16:09.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/36 file after the snapshot 2024-08-31T12:16:09.735 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/37 file after the snapshot 2024-08-31T12:16:09.736 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/38 file after the snapshot 2024-08-31T12:16:09.737 INFO:tasks.workunit.client.0.smithi164.stdout: create 193/39 file after the snapshot 2024-08-31T12:16:09.738 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/.snap/snap-subdir-test 2024-08-31T12:16:09.764 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/30 file after the snapshot 2024-08-31T12:16:09.765 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/31 file after the snapshot 2024-08-31T12:16:09.767 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/32 file after the snapshot 2024-08-31T12:16:09.769 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/33 file after the snapshot 2024-08-31T12:16:09.773 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/34 file after the snapshot 2024-08-31T12:16:09.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/35 file after the snapshot 2024-08-31T12:16:09.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/36 file after the snapshot 2024-08-31T12:16:09.786 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/37 file after the snapshot 2024-08-31T12:16:09.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/38 file after the snapshot 2024-08-31T12:16:09.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 194/39 file after the snapshot 2024-08-31T12:16:09.789 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/.snap/snap-subdir-test 2024-08-31T12:16:09.815 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/30 file after the snapshot 2024-08-31T12:16:09.818 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/31 file after the snapshot 2024-08-31T12:16:09.821 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/32 file after the snapshot 2024-08-31T12:16:09.830 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/33 file after the snapshot 2024-08-31T12:16:09.833 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/34 file after the snapshot 2024-08-31T12:16:09.834 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/35 file after the snapshot 2024-08-31T12:16:09.835 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/36 file after the snapshot 2024-08-31T12:16:09.836 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/37 file after the snapshot 2024-08-31T12:16:09.837 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/38 file after the snapshot 2024-08-31T12:16:09.837 INFO:tasks.workunit.client.0.smithi164.stdout: create 195/39 file after the snapshot 2024-08-31T12:16:09.838 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/.snap/snap-subdir-test 2024-08-31T12:16:09.867 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/30 file after the snapshot 2024-08-31T12:16:09.869 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/31 file after the snapshot 2024-08-31T12:16:09.870 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/32 file after the snapshot 2024-08-31T12:16:09.874 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/33 file after the snapshot 2024-08-31T12:16:09.883 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/34 file after the snapshot 2024-08-31T12:16:09.885 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/35 file after the snapshot 2024-08-31T12:16:09.886 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/36 file after the snapshot 2024-08-31T12:16:09.887 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/37 file after the snapshot 2024-08-31T12:16:09.888 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/38 file after the snapshot 2024-08-31T12:16:09.889 INFO:tasks.workunit.client.0.smithi164.stdout: create 196/39 file after the snapshot 2024-08-31T12:16:09.890 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/.snap/snap-subdir-test 2024-08-31T12:16:09.915 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/30 file after the snapshot 2024-08-31T12:16:09.917 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/31 file after the snapshot 2024-08-31T12:16:09.919 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/32 file after the snapshot 2024-08-31T12:16:09.920 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/33 file after the snapshot 2024-08-31T12:16:09.921 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/34 file after the snapshot 2024-08-31T12:16:09.923 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/35 file after the snapshot 2024-08-31T12:16:09.926 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/36 file after the snapshot 2024-08-31T12:16:09.934 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/37 file after the snapshot 2024-08-31T12:16:09.936 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/38 file after the snapshot 2024-08-31T12:16:09.937 INFO:tasks.workunit.client.0.smithi164.stdout: create 197/39 file after the snapshot 2024-08-31T12:16:10.188 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/.snap/snap-subdir-test 2024-08-31T12:16:10.218 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/30 file after the snapshot 2024-08-31T12:16:10.219 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/31 file after the snapshot 2024-08-31T12:16:10.220 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/32 file after the snapshot 2024-08-31T12:16:10.221 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/33 file after the snapshot 2024-08-31T12:16:10.222 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/34 file after the snapshot 2024-08-31T12:16:10.224 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/35 file after the snapshot 2024-08-31T12:16:10.229 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/36 file after the snapshot 2024-08-31T12:16:10.237 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/37 file after the snapshot 2024-08-31T12:16:10.238 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/38 file after the snapshot 2024-08-31T12:16:10.239 INFO:tasks.workunit.client.0.smithi164.stdout: create 198/39 file after the snapshot 2024-08-31T12:16:10.240 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/.snap/snap-subdir-test 2024-08-31T12:16:10.266 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/30 file after the snapshot 2024-08-31T12:16:10.267 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/31 file after the snapshot 2024-08-31T12:16:10.269 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/32 file after the snapshot 2024-08-31T12:16:10.270 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/33 file after the snapshot 2024-08-31T12:16:10.271 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/34 file after the snapshot 2024-08-31T12:16:10.273 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/35 file after the snapshot 2024-08-31T12:16:10.277 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/36 file after the snapshot 2024-08-31T12:16:10.291 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/37 file after the snapshot 2024-08-31T12:16:10.336 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/38 file after the snapshot 2024-08-31T12:16:10.337 INFO:tasks.workunit.client.0.smithi164.stdout: create 199/39 file after the snapshot 2024-08-31T12:16:10.339 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/.snap/snap-subdir-test 2024-08-31T12:16:10.367 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/30 file after the snapshot 2024-08-31T12:16:10.369 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/31 file after the snapshot 2024-08-31T12:16:10.370 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/32 file after the snapshot 2024-08-31T12:16:10.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/33 file after the snapshot 2024-08-31T12:16:10.373 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/34 file after the snapshot 2024-08-31T12:16:10.374 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/35 file after the snapshot 2024-08-31T12:16:10.376 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/36 file after the snapshot 2024-08-31T12:16:10.377 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/37 file after the snapshot 2024-08-31T12:16:10.379 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/38 file after the snapshot 2024-08-31T12:16:10.380 INFO:tasks.workunit.client.0.smithi164.stdout: create 200/39 file after the snapshot 2024-08-31T12:16:10.382 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/.snap/snap-subdir-test 2024-08-31T12:16:10.401 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/30 file after the snapshot 2024-08-31T12:16:10.402 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/31 file after the snapshot 2024-08-31T12:16:10.403 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/32 file after the snapshot 2024-08-31T12:16:10.404 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/33 file after the snapshot 2024-08-31T12:16:10.405 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/34 file after the snapshot 2024-08-31T12:16:10.406 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/35 file after the snapshot 2024-08-31T12:16:10.407 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/36 file after the snapshot 2024-08-31T12:16:10.408 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/37 file after the snapshot 2024-08-31T12:16:10.409 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/38 file after the snapshot 2024-08-31T12:16:10.410 INFO:tasks.workunit.client.0.smithi164.stdout: create 201/39 file after the snapshot 2024-08-31T12:16:10.411 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/.snap/snap-subdir-test 2024-08-31T12:16:10.431 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/30 file after the snapshot 2024-08-31T12:16:10.431 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/31 file after the snapshot 2024-08-31T12:16:10.433 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/32 file after the snapshot 2024-08-31T12:16:10.433 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/33 file after the snapshot 2024-08-31T12:16:10.434 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/34 file after the snapshot 2024-08-31T12:16:10.435 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/35 file after the snapshot 2024-08-31T12:16:10.436 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/36 file after the snapshot 2024-08-31T12:16:10.437 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/37 file after the snapshot 2024-08-31T12:16:10.438 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/38 file after the snapshot 2024-08-31T12:16:10.439 INFO:tasks.workunit.client.0.smithi164.stdout: create 202/39 file after the snapshot 2024-08-31T12:16:10.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/.snap/snap-subdir-test 2024-08-31T12:16:10.459 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/30 file after the snapshot 2024-08-31T12:16:10.460 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/31 file after the snapshot 2024-08-31T12:16:10.461 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/32 file after the snapshot 2024-08-31T12:16:10.462 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/33 file after the snapshot 2024-08-31T12:16:10.463 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/34 file after the snapshot 2024-08-31T12:16:10.464 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/35 file after the snapshot 2024-08-31T12:16:10.465 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/36 file after the snapshot 2024-08-31T12:16:10.466 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/37 file after the snapshot 2024-08-31T12:16:10.467 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/38 file after the snapshot 2024-08-31T12:16:10.468 INFO:tasks.workunit.client.0.smithi164.stdout: create 203/39 file after the snapshot 2024-08-31T12:16:10.469 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/.snap/snap-subdir-test 2024-08-31T12:16:10.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/30 file after the snapshot 2024-08-31T12:16:10.489 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/31 file after the snapshot 2024-08-31T12:16:10.490 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/32 file after the snapshot 2024-08-31T12:16:10.492 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/33 file after the snapshot 2024-08-31T12:16:10.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/34 file after the snapshot 2024-08-31T12:16:10.494 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/35 file after the snapshot 2024-08-31T12:16:10.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/36 file after the snapshot 2024-08-31T12:16:10.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/37 file after the snapshot 2024-08-31T12:16:10.498 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/38 file after the snapshot 2024-08-31T12:16:10.499 INFO:tasks.workunit.client.0.smithi164.stdout: create 204/39 file after the snapshot 2024-08-31T12:16:10.500 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/.snap/snap-subdir-test 2024-08-31T12:16:10.519 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/30 file after the snapshot 2024-08-31T12:16:10.520 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/31 file after the snapshot 2024-08-31T12:16:10.521 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/32 file after the snapshot 2024-08-31T12:16:10.523 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/33 file after the snapshot 2024-08-31T12:16:10.524 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/34 file after the snapshot 2024-08-31T12:16:10.525 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/35 file after the snapshot 2024-08-31T12:16:10.526 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/36 file after the snapshot 2024-08-31T12:16:10.528 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/37 file after the snapshot 2024-08-31T12:16:10.529 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/38 file after the snapshot 2024-08-31T12:16:10.530 INFO:tasks.workunit.client.0.smithi164.stdout: create 205/39 file after the snapshot 2024-08-31T12:16:10.531 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/.snap/snap-subdir-test 2024-08-31T12:16:10.549 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/30 file after the snapshot 2024-08-31T12:16:10.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/31 file after the snapshot 2024-08-31T12:16:10.552 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/32 file after the snapshot 2024-08-31T12:16:10.553 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/33 file after the snapshot 2024-08-31T12:16:10.554 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/34 file after the snapshot 2024-08-31T12:16:10.555 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/35 file after the snapshot 2024-08-31T12:16:10.557 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/36 file after the snapshot 2024-08-31T12:16:10.558 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/37 file after the snapshot 2024-08-31T12:16:10.559 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/38 file after the snapshot 2024-08-31T12:16:10.560 INFO:tasks.workunit.client.0.smithi164.stdout: create 206/39 file after the snapshot 2024-08-31T12:16:10.562 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/.snap/snap-subdir-test 2024-08-31T12:16:10.580 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/30 file after the snapshot 2024-08-31T12:16:10.581 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/31 file after the snapshot 2024-08-31T12:16:10.581 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/32 file after the snapshot 2024-08-31T12:16:10.582 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/33 file after the snapshot 2024-08-31T12:16:10.583 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/34 file after the snapshot 2024-08-31T12:16:10.584 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/35 file after the snapshot 2024-08-31T12:16:10.585 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/36 file after the snapshot 2024-08-31T12:16:10.586 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/37 file after the snapshot 2024-08-31T12:16:10.587 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/38 file after the snapshot 2024-08-31T12:16:10.588 INFO:tasks.workunit.client.0.smithi164.stdout: create 207/39 file after the snapshot 2024-08-31T12:16:10.589 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/.snap/snap-subdir-test 2024-08-31T12:16:10.607 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/30 file after the snapshot 2024-08-31T12:16:10.608 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/31 file after the snapshot 2024-08-31T12:16:10.609 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/32 file after the snapshot 2024-08-31T12:16:10.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/33 file after the snapshot 2024-08-31T12:16:10.611 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/34 file after the snapshot 2024-08-31T12:16:10.612 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/35 file after the snapshot 2024-08-31T12:16:10.613 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/36 file after the snapshot 2024-08-31T12:16:10.614 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/37 file after the snapshot 2024-08-31T12:16:10.615 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/38 file after the snapshot 2024-08-31T12:16:10.616 INFO:tasks.workunit.client.0.smithi164.stdout: create 208/39 file after the snapshot 2024-08-31T12:16:10.617 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/.snap/snap-subdir-test 2024-08-31T12:16:10.634 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/30 file after the snapshot 2024-08-31T12:16:10.635 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/31 file after the snapshot 2024-08-31T12:16:10.637 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/32 file after the snapshot 2024-08-31T12:16:10.637 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/33 file after the snapshot 2024-08-31T12:16:10.638 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/34 file after the snapshot 2024-08-31T12:16:10.639 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/35 file after the snapshot 2024-08-31T12:16:10.640 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/36 file after the snapshot 2024-08-31T12:16:10.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/37 file after the snapshot 2024-08-31T12:16:10.642 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/38 file after the snapshot 2024-08-31T12:16:10.643 INFO:tasks.workunit.client.0.smithi164.stdout: create 209/39 file after the snapshot 2024-08-31T12:16:10.644 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/.snap/snap-subdir-test 2024-08-31T12:16:10.664 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/30 file after the snapshot 2024-08-31T12:16:10.665 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/31 file after the snapshot 2024-08-31T12:16:10.666 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/32 file after the snapshot 2024-08-31T12:16:10.667 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/33 file after the snapshot 2024-08-31T12:16:10.668 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/34 file after the snapshot 2024-08-31T12:16:10.669 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/35 file after the snapshot 2024-08-31T12:16:10.670 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/36 file after the snapshot 2024-08-31T12:16:10.671 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/37 file after the snapshot 2024-08-31T12:16:10.672 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/38 file after the snapshot 2024-08-31T12:16:10.673 INFO:tasks.workunit.client.0.smithi164.stdout: create 210/39 file after the snapshot 2024-08-31T12:16:10.674 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/.snap/snap-subdir-test 2024-08-31T12:16:10.693 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/30 file after the snapshot 2024-08-31T12:16:10.694 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/31 file after the snapshot 2024-08-31T12:16:10.695 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/32 file after the snapshot 2024-08-31T12:16:10.696 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/33 file after the snapshot 2024-08-31T12:16:10.697 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/34 file after the snapshot 2024-08-31T12:16:10.697 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/35 file after the snapshot 2024-08-31T12:16:10.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/36 file after the snapshot 2024-08-31T12:16:10.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/37 file after the snapshot 2024-08-31T12:16:10.700 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/38 file after the snapshot 2024-08-31T12:16:10.701 INFO:tasks.workunit.client.0.smithi164.stdout: create 211/39 file after the snapshot 2024-08-31T12:16:10.702 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/.snap/snap-subdir-test 2024-08-31T12:16:10.724 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/30 file after the snapshot 2024-08-31T12:16:10.725 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/31 file after the snapshot 2024-08-31T12:16:10.726 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/32 file after the snapshot 2024-08-31T12:16:10.727 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/33 file after the snapshot 2024-08-31T12:16:10.728 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/34 file after the snapshot 2024-08-31T12:16:10.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/35 file after the snapshot 2024-08-31T12:16:10.730 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/36 file after the snapshot 2024-08-31T12:16:10.731 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/37 file after the snapshot 2024-08-31T12:16:10.732 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/38 file after the snapshot 2024-08-31T12:16:10.733 INFO:tasks.workunit.client.0.smithi164.stdout: create 212/39 file after the snapshot 2024-08-31T12:16:10.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/.snap/snap-subdir-test 2024-08-31T12:16:10.754 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/30 file after the snapshot 2024-08-31T12:16:10.755 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/31 file after the snapshot 2024-08-31T12:16:10.757 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/32 file after the snapshot 2024-08-31T12:16:10.758 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/33 file after the snapshot 2024-08-31T12:16:10.760 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/34 file after the snapshot 2024-08-31T12:16:10.761 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/35 file after the snapshot 2024-08-31T12:16:10.763 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/36 file after the snapshot 2024-08-31T12:16:10.764 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/37 file after the snapshot 2024-08-31T12:16:10.765 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/38 file after the snapshot 2024-08-31T12:16:10.767 INFO:tasks.workunit.client.0.smithi164.stdout: create 213/39 file after the snapshot 2024-08-31T12:16:10.768 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/.snap/snap-subdir-test 2024-08-31T12:16:10.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/30 file after the snapshot 2024-08-31T12:16:10.789 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/31 file after the snapshot 2024-08-31T12:16:10.790 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/32 file after the snapshot 2024-08-31T12:16:10.792 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/33 file after the snapshot 2024-08-31T12:16:10.793 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/34 file after the snapshot 2024-08-31T12:16:10.794 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/35 file after the snapshot 2024-08-31T12:16:10.796 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/36 file after the snapshot 2024-08-31T12:16:10.797 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/37 file after the snapshot 2024-08-31T12:16:10.799 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/38 file after the snapshot 2024-08-31T12:16:10.800 INFO:tasks.workunit.client.0.smithi164.stdout: create 214/39 file after the snapshot 2024-08-31T12:16:10.864 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/.snap/snap-subdir-test 2024-08-31T12:16:10.903 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/30 file after the snapshot 2024-08-31T12:16:10.904 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/31 file after the snapshot 2024-08-31T12:16:10.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/32 file after the snapshot 2024-08-31T12:16:10.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/33 file after the snapshot 2024-08-31T12:16:10.906 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/34 file after the snapshot 2024-08-31T12:16:10.907 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/35 file after the snapshot 2024-08-31T12:16:10.909 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/36 file after the snapshot 2024-08-31T12:16:10.909 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/37 file after the snapshot 2024-08-31T12:16:11.248 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/38 file after the snapshot 2024-08-31T12:16:11.249 INFO:tasks.workunit.client.0.smithi164.stdout: create 215/39 file after the snapshot 2024-08-31T12:16:11.250 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/.snap/snap-subdir-test 2024-08-31T12:16:11.269 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/30 file after the snapshot 2024-08-31T12:16:11.270 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/31 file after the snapshot 2024-08-31T12:16:11.271 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/32 file after the snapshot 2024-08-31T12:16:11.272 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/33 file after the snapshot 2024-08-31T12:16:11.273 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/34 file after the snapshot 2024-08-31T12:16:11.274 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/35 file after the snapshot 2024-08-31T12:16:11.275 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/36 file after the snapshot 2024-08-31T12:16:11.276 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/37 file after the snapshot 2024-08-31T12:16:11.277 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/38 file after the snapshot 2024-08-31T12:16:11.278 INFO:tasks.workunit.client.0.smithi164.stdout: create 216/39 file after the snapshot 2024-08-31T12:16:11.279 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/.snap/snap-subdir-test 2024-08-31T12:16:11.297 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/30 file after the snapshot 2024-08-31T12:16:11.298 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/31 file after the snapshot 2024-08-31T12:16:11.299 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/32 file after the snapshot 2024-08-31T12:16:11.300 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/33 file after the snapshot 2024-08-31T12:16:11.301 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/34 file after the snapshot 2024-08-31T12:16:11.302 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/35 file after the snapshot 2024-08-31T12:16:11.303 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/36 file after the snapshot 2024-08-31T12:16:11.304 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/37 file after the snapshot 2024-08-31T12:16:11.305 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/38 file after the snapshot 2024-08-31T12:16:11.306 INFO:tasks.workunit.client.0.smithi164.stdout: create 217/39 file after the snapshot 2024-08-31T12:16:11.307 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/.snap/snap-subdir-test 2024-08-31T12:16:11.326 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/30 file after the snapshot 2024-08-31T12:16:11.327 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/31 file after the snapshot 2024-08-31T12:16:11.328 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/32 file after the snapshot 2024-08-31T12:16:11.329 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/33 file after the snapshot 2024-08-31T12:16:11.330 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/34 file after the snapshot 2024-08-31T12:16:11.331 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/35 file after the snapshot 2024-08-31T12:16:11.332 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/36 file after the snapshot 2024-08-31T12:16:11.333 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/37 file after the snapshot 2024-08-31T12:16:11.334 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/38 file after the snapshot 2024-08-31T12:16:11.334 INFO:tasks.workunit.client.0.smithi164.stdout: create 218/39 file after the snapshot 2024-08-31T12:16:11.336 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/.snap/snap-subdir-test 2024-08-31T12:16:11.353 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/30 file after the snapshot 2024-08-31T12:16:11.354 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/31 file after the snapshot 2024-08-31T12:16:11.355 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/32 file after the snapshot 2024-08-31T12:16:11.356 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/33 file after the snapshot 2024-08-31T12:16:11.357 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/34 file after the snapshot 2024-08-31T12:16:11.358 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/35 file after the snapshot 2024-08-31T12:16:11.359 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/36 file after the snapshot 2024-08-31T12:16:11.360 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/37 file after the snapshot 2024-08-31T12:16:11.361 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/38 file after the snapshot 2024-08-31T12:16:11.362 INFO:tasks.workunit.client.0.smithi164.stdout: create 219/39 file after the snapshot 2024-08-31T12:16:11.363 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/.snap/snap-subdir-test 2024-08-31T12:16:11.384 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/30 file after the snapshot 2024-08-31T12:16:11.385 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/31 file after the snapshot 2024-08-31T12:16:11.386 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/32 file after the snapshot 2024-08-31T12:16:11.387 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/33 file after the snapshot 2024-08-31T12:16:11.388 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/34 file after the snapshot 2024-08-31T12:16:11.389 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/35 file after the snapshot 2024-08-31T12:16:11.390 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/36 file after the snapshot 2024-08-31T12:16:11.391 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/37 file after the snapshot 2024-08-31T12:16:11.392 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/38 file after the snapshot 2024-08-31T12:16:11.392 INFO:tasks.workunit.client.0.smithi164.stdout: create 220/39 file after the snapshot 2024-08-31T12:16:11.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/.snap/snap-subdir-test 2024-08-31T12:16:11.415 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/30 file after the snapshot 2024-08-31T12:16:11.415 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/31 file after the snapshot 2024-08-31T12:16:11.416 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/32 file after the snapshot 2024-08-31T12:16:11.417 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/33 file after the snapshot 2024-08-31T12:16:11.418 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/34 file after the snapshot 2024-08-31T12:16:11.419 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/35 file after the snapshot 2024-08-31T12:16:11.420 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/36 file after the snapshot 2024-08-31T12:16:11.421 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/37 file after the snapshot 2024-08-31T12:16:11.422 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/38 file after the snapshot 2024-08-31T12:16:11.423 INFO:tasks.workunit.client.0.smithi164.stdout: create 221/39 file after the snapshot 2024-08-31T12:16:11.424 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/.snap/snap-subdir-test 2024-08-31T12:16:11.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/30 file after the snapshot 2024-08-31T12:16:11.446 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/31 file after the snapshot 2024-08-31T12:16:11.447 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/32 file after the snapshot 2024-08-31T12:16:11.448 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/33 file after the snapshot 2024-08-31T12:16:11.449 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/34 file after the snapshot 2024-08-31T12:16:11.450 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/35 file after the snapshot 2024-08-31T12:16:11.451 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/36 file after the snapshot 2024-08-31T12:16:11.452 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/37 file after the snapshot 2024-08-31T12:16:11.453 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/38 file after the snapshot 2024-08-31T12:16:11.454 INFO:tasks.workunit.client.0.smithi164.stdout: create 222/39 file after the snapshot 2024-08-31T12:16:11.455 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/.snap/snap-subdir-test 2024-08-31T12:16:11.476 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/30 file after the snapshot 2024-08-31T12:16:11.477 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/31 file after the snapshot 2024-08-31T12:16:11.478 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/32 file after the snapshot 2024-08-31T12:16:11.478 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/33 file after the snapshot 2024-08-31T12:16:11.479 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/34 file after the snapshot 2024-08-31T12:16:11.480 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/35 file after the snapshot 2024-08-31T12:16:11.481 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/36 file after the snapshot 2024-08-31T12:16:11.482 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/37 file after the snapshot 2024-08-31T12:16:11.483 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/38 file after the snapshot 2024-08-31T12:16:11.484 INFO:tasks.workunit.client.0.smithi164.stdout: create 223/39 file after the snapshot 2024-08-31T12:16:11.485 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/.snap/snap-subdir-test 2024-08-31T12:16:11.506 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/30 file after the snapshot 2024-08-31T12:16:11.507 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/31 file after the snapshot 2024-08-31T12:16:11.508 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/32 file after the snapshot 2024-08-31T12:16:11.509 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/33 file after the snapshot 2024-08-31T12:16:11.510 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/34 file after the snapshot 2024-08-31T12:16:11.511 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/35 file after the snapshot 2024-08-31T12:16:11.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/36 file after the snapshot 2024-08-31T12:16:11.513 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/37 file after the snapshot 2024-08-31T12:16:11.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/38 file after the snapshot 2024-08-31T12:16:11.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 224/39 file after the snapshot 2024-08-31T12:16:11.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/.snap/snap-subdir-test 2024-08-31T12:16:11.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/30 file after the snapshot 2024-08-31T12:16:11.537 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/31 file after the snapshot 2024-08-31T12:16:11.538 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/32 file after the snapshot 2024-08-31T12:16:11.539 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/33 file after the snapshot 2024-08-31T12:16:11.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/34 file after the snapshot 2024-08-31T12:16:11.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/35 file after the snapshot 2024-08-31T12:16:11.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/36 file after the snapshot 2024-08-31T12:16:11.543 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/37 file after the snapshot 2024-08-31T12:16:11.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/38 file after the snapshot 2024-08-31T12:16:11.545 INFO:tasks.workunit.client.0.smithi164.stdout: create 225/39 file after the snapshot 2024-08-31T12:16:11.546 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/.snap/snap-subdir-test 2024-08-31T12:16:11.564 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/30 file after the snapshot 2024-08-31T12:16:11.565 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/31 file after the snapshot 2024-08-31T12:16:11.566 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/32 file after the snapshot 2024-08-31T12:16:11.567 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/33 file after the snapshot 2024-08-31T12:16:11.568 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/34 file after the snapshot 2024-08-31T12:16:11.569 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/35 file after the snapshot 2024-08-31T12:16:11.570 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/36 file after the snapshot 2024-08-31T12:16:11.571 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/37 file after the snapshot 2024-08-31T12:16:11.572 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/38 file after the snapshot 2024-08-31T12:16:11.573 INFO:tasks.workunit.client.0.smithi164.stdout: create 226/39 file after the snapshot 2024-08-31T12:16:11.574 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/.snap/snap-subdir-test 2024-08-31T12:16:11.594 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/30 file after the snapshot 2024-08-31T12:16:11.595 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/31 file after the snapshot 2024-08-31T12:16:12.197 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/32 file after the snapshot 2024-08-31T12:16:12.197 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/33 file after the snapshot 2024-08-31T12:16:12.198 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/34 file after the snapshot 2024-08-31T12:16:12.199 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/35 file after the snapshot 2024-08-31T12:16:12.200 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/36 file after the snapshot 2024-08-31T12:16:12.201 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/37 file after the snapshot 2024-08-31T12:16:12.202 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/38 file after the snapshot 2024-08-31T12:16:12.203 INFO:tasks.workunit.client.0.smithi164.stdout: create 227/39 file after the snapshot 2024-08-31T12:16:12.205 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/.snap/snap-subdir-test 2024-08-31T12:16:12.226 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/30 file after the snapshot 2024-08-31T12:16:12.227 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/31 file after the snapshot 2024-08-31T12:16:12.228 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/32 file after the snapshot 2024-08-31T12:16:12.229 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/33 file after the snapshot 2024-08-31T12:16:12.230 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/34 file after the snapshot 2024-08-31T12:16:12.231 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/35 file after the snapshot 2024-08-31T12:16:12.232 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/36 file after the snapshot 2024-08-31T12:16:12.233 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/37 file after the snapshot 2024-08-31T12:16:12.234 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/38 file after the snapshot 2024-08-31T12:16:12.235 INFO:tasks.workunit.client.0.smithi164.stdout: create 228/39 file after the snapshot 2024-08-31T12:16:12.236 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/.snap/snap-subdir-test 2024-08-31T12:16:12.256 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/30 file after the snapshot 2024-08-31T12:16:12.257 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/31 file after the snapshot 2024-08-31T12:16:12.258 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/32 file after the snapshot 2024-08-31T12:16:12.259 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/33 file after the snapshot 2024-08-31T12:16:12.260 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/34 file after the snapshot 2024-08-31T12:16:12.261 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/35 file after the snapshot 2024-08-31T12:16:12.262 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/36 file after the snapshot 2024-08-31T12:16:12.263 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/37 file after the snapshot 2024-08-31T12:16:12.264 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/38 file after the snapshot 2024-08-31T12:16:12.265 INFO:tasks.workunit.client.0.smithi164.stdout: create 229/39 file after the snapshot 2024-08-31T12:16:12.266 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/.snap/snap-subdir-test 2024-08-31T12:16:12.286 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/30 file after the snapshot 2024-08-31T12:16:12.286 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/31 file after the snapshot 2024-08-31T12:16:12.287 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/32 file after the snapshot 2024-08-31T12:16:12.289 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/33 file after the snapshot 2024-08-31T12:16:12.289 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/34 file after the snapshot 2024-08-31T12:16:12.291 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/35 file after the snapshot 2024-08-31T12:16:12.291 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/36 file after the snapshot 2024-08-31T12:16:12.292 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/37 file after the snapshot 2024-08-31T12:16:12.293 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/38 file after the snapshot 2024-08-31T12:16:12.294 INFO:tasks.workunit.client.0.smithi164.stdout: create 230/39 file after the snapshot 2024-08-31T12:16:12.295 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/.snap/snap-subdir-test 2024-08-31T12:16:12.315 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/30 file after the snapshot 2024-08-31T12:16:12.316 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/31 file after the snapshot 2024-08-31T12:16:12.317 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/32 file after the snapshot 2024-08-31T12:16:12.318 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/33 file after the snapshot 2024-08-31T12:16:12.319 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/34 file after the snapshot 2024-08-31T12:16:12.320 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/35 file after the snapshot 2024-08-31T12:16:12.320 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/36 file after the snapshot 2024-08-31T12:16:12.321 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/37 file after the snapshot 2024-08-31T12:16:12.323 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/38 file after the snapshot 2024-08-31T12:16:12.323 INFO:tasks.workunit.client.0.smithi164.stdout: create 231/39 file after the snapshot 2024-08-31T12:16:12.324 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/.snap/snap-subdir-test 2024-08-31T12:16:12.343 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/30 file after the snapshot 2024-08-31T12:16:12.344 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/31 file after the snapshot 2024-08-31T12:16:12.345 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/32 file after the snapshot 2024-08-31T12:16:12.346 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/33 file after the snapshot 2024-08-31T12:16:12.347 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/34 file after the snapshot 2024-08-31T12:16:12.348 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/35 file after the snapshot 2024-08-31T12:16:12.349 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/36 file after the snapshot 2024-08-31T12:16:12.350 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/37 file after the snapshot 2024-08-31T12:16:12.351 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/38 file after the snapshot 2024-08-31T12:16:12.351 INFO:tasks.workunit.client.0.smithi164.stdout: create 232/39 file after the snapshot 2024-08-31T12:16:12.352 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/.snap/snap-subdir-test 2024-08-31T12:16:12.370 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/30 file after the snapshot 2024-08-31T12:16:12.370 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/31 file after the snapshot 2024-08-31T12:16:12.371 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/32 file after the snapshot 2024-08-31T12:16:12.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/33 file after the snapshot 2024-08-31T12:16:12.373 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/34 file after the snapshot 2024-08-31T12:16:12.374 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/35 file after the snapshot 2024-08-31T12:16:12.375 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/36 file after the snapshot 2024-08-31T12:16:12.376 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/37 file after the snapshot 2024-08-31T12:16:12.377 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/38 file after the snapshot 2024-08-31T12:16:12.378 INFO:tasks.workunit.client.0.smithi164.stdout: create 233/39 file after the snapshot 2024-08-31T12:16:12.378 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/.snap/snap-subdir-test 2024-08-31T12:16:12.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/30 file after the snapshot 2024-08-31T12:16:12.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/31 file after the snapshot 2024-08-31T12:16:12.394 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/32 file after the snapshot 2024-08-31T12:16:12.395 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/33 file after the snapshot 2024-08-31T12:16:12.396 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/34 file after the snapshot 2024-08-31T12:16:12.397 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/35 file after the snapshot 2024-08-31T12:16:12.398 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/36 file after the snapshot 2024-08-31T12:16:12.399 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/37 file after the snapshot 2024-08-31T12:16:12.400 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/38 file after the snapshot 2024-08-31T12:16:12.401 INFO:tasks.workunit.client.0.smithi164.stdout: create 234/39 file after the snapshot 2024-08-31T12:16:12.402 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/.snap/snap-subdir-test 2024-08-31T12:16:12.416 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/30 file after the snapshot 2024-08-31T12:16:12.417 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/31 file after the snapshot 2024-08-31T12:16:12.418 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/32 file after the snapshot 2024-08-31T12:16:12.419 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/33 file after the snapshot 2024-08-31T12:16:12.420 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/34 file after the snapshot 2024-08-31T12:16:12.421 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/35 file after the snapshot 2024-08-31T12:16:12.422 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/36 file after the snapshot 2024-08-31T12:16:12.422 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/37 file after the snapshot 2024-08-31T12:16:12.424 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/38 file after the snapshot 2024-08-31T12:16:12.424 INFO:tasks.workunit.client.0.smithi164.stdout: create 235/39 file after the snapshot 2024-08-31T12:16:12.425 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/.snap/snap-subdir-test 2024-08-31T12:16:12.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/30 file after the snapshot 2024-08-31T12:16:12.441 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/31 file after the snapshot 2024-08-31T12:16:12.442 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/32 file after the snapshot 2024-08-31T12:16:12.442 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/33 file after the snapshot 2024-08-31T12:16:12.444 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/34 file after the snapshot 2024-08-31T12:16:12.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/35 file after the snapshot 2024-08-31T12:16:12.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/36 file after the snapshot 2024-08-31T12:16:12.446 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/37 file after the snapshot 2024-08-31T12:16:12.447 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/38 file after the snapshot 2024-08-31T12:16:12.448 INFO:tasks.workunit.client.0.smithi164.stdout: create 236/39 file after the snapshot 2024-08-31T12:16:12.449 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/.snap/snap-subdir-test 2024-08-31T12:16:12.463 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/30 file after the snapshot 2024-08-31T12:16:12.464 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/31 file after the snapshot 2024-08-31T12:16:12.465 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/32 file after the snapshot 2024-08-31T12:16:12.466 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/33 file after the snapshot 2024-08-31T12:16:12.467 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/34 file after the snapshot 2024-08-31T12:16:12.468 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/35 file after the snapshot 2024-08-31T12:16:12.469 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/36 file after the snapshot 2024-08-31T12:16:12.470 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/37 file after the snapshot 2024-08-31T12:16:12.471 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/38 file after the snapshot 2024-08-31T12:16:12.472 INFO:tasks.workunit.client.0.smithi164.stdout: create 237/39 file after the snapshot 2024-08-31T12:16:12.473 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/.snap/snap-subdir-test 2024-08-31T12:16:12.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/30 file after the snapshot 2024-08-31T12:16:12.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/31 file after the snapshot 2024-08-31T12:16:12.489 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/32 file after the snapshot 2024-08-31T12:16:12.490 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/33 file after the snapshot 2024-08-31T12:16:12.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/34 file after the snapshot 2024-08-31T12:16:12.492 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/35 file after the snapshot 2024-08-31T12:16:12.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/36 file after the snapshot 2024-08-31T12:16:12.494 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/37 file after the snapshot 2024-08-31T12:16:12.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/38 file after the snapshot 2024-08-31T12:16:12.496 INFO:tasks.workunit.client.0.smithi164.stdout: create 238/39 file after the snapshot 2024-08-31T12:16:12.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/.snap/snap-subdir-test 2024-08-31T12:16:12.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/30 file after the snapshot 2024-08-31T12:16:12.512 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/31 file after the snapshot 2024-08-31T12:16:12.513 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/32 file after the snapshot 2024-08-31T12:16:12.514 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/33 file after the snapshot 2024-08-31T12:16:12.515 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/34 file after the snapshot 2024-08-31T12:16:12.516 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/35 file after the snapshot 2024-08-31T12:16:12.517 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/36 file after the snapshot 2024-08-31T12:16:12.518 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/37 file after the snapshot 2024-08-31T12:16:12.519 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/38 file after the snapshot 2024-08-31T12:16:12.520 INFO:tasks.workunit.client.0.smithi164.stdout: create 239/39 file after the snapshot 2024-08-31T12:16:12.521 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/.snap/snap-subdir-test 2024-08-31T12:16:12.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/30 file after the snapshot 2024-08-31T12:16:12.537 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/31 file after the snapshot 2024-08-31T12:16:12.538 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/32 file after the snapshot 2024-08-31T12:16:12.539 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/33 file after the snapshot 2024-08-31T12:16:12.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/34 file after the snapshot 2024-08-31T12:16:12.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/35 file after the snapshot 2024-08-31T12:16:12.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/36 file after the snapshot 2024-08-31T12:16:12.543 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/37 file after the snapshot 2024-08-31T12:16:12.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/38 file after the snapshot 2024-08-31T12:16:12.545 INFO:tasks.workunit.client.0.smithi164.stdout: create 240/39 file after the snapshot 2024-08-31T12:16:12.546 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/.snap/snap-subdir-test 2024-08-31T12:16:12.580 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/30 file after the snapshot 2024-08-31T12:16:12.581 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/31 file after the snapshot 2024-08-31T12:16:12.582 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/32 file after the snapshot 2024-08-31T12:16:12.583 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/33 file after the snapshot 2024-08-31T12:16:12.584 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/34 file after the snapshot 2024-08-31T12:16:12.585 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/35 file after the snapshot 2024-08-31T12:16:12.586 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/36 file after the snapshot 2024-08-31T12:16:12.587 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/37 file after the snapshot 2024-08-31T12:16:12.588 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/38 file after the snapshot 2024-08-31T12:16:12.589 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:12.590 INFO:tasks.workunit.client.0.smithi164.stdout: create 241/39 file after the snapshot 2024-08-31T12:16:12.590 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/.snap/snap-subdir-test 2024-08-31T12:16:12.607 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/30 file after the snapshot 2024-08-31T12:16:12.608 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/31 file after the snapshot 2024-08-31T12:16:12.609 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/32 file after the snapshot 2024-08-31T12:16:12.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/33 file after the snapshot 2024-08-31T12:16:12.611 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/34 file after the snapshot 2024-08-31T12:16:12.613 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/35 file after the snapshot 2024-08-31T12:16:12.614 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/36 file after the snapshot 2024-08-31T12:16:12.615 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/37 file after the snapshot 2024-08-31T12:16:12.616 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/38 file after the snapshot 2024-08-31T12:16:12.617 INFO:tasks.workunit.client.0.smithi164.stdout: create 242/39 file after the snapshot 2024-08-31T12:16:12.618 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/.snap/snap-subdir-test 2024-08-31T12:16:12.633 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/30 file after the snapshot 2024-08-31T12:16:12.633 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/31 file after the snapshot 2024-08-31T12:16:12.635 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/32 file after the snapshot 2024-08-31T12:16:12.635 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/33 file after the snapshot 2024-08-31T12:16:12.636 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/34 file after the snapshot 2024-08-31T12:16:12.637 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/35 file after the snapshot 2024-08-31T12:16:12.638 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/36 file after the snapshot 2024-08-31T12:16:12.639 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/37 file after the snapshot 2024-08-31T12:16:12.640 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/38 file after the snapshot 2024-08-31T12:16:12.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 243/39 file after the snapshot 2024-08-31T12:16:12.642 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/.snap/snap-subdir-test 2024-08-31T12:16:12.657 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/30 file after the snapshot 2024-08-31T12:16:12.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/31 file after the snapshot 2024-08-31T12:16:12.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/32 file after the snapshot 2024-08-31T12:16:12.659 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/33 file after the snapshot 2024-08-31T12:16:12.660 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/34 file after the snapshot 2024-08-31T12:16:12.661 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/35 file after the snapshot 2024-08-31T12:16:12.662 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/36 file after the snapshot 2024-08-31T12:16:12.663 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/37 file after the snapshot 2024-08-31T12:16:12.664 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/38 file after the snapshot 2024-08-31T12:16:12.665 INFO:tasks.workunit.client.0.smithi164.stdout: create 244/39 file after the snapshot 2024-08-31T12:16:12.665 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/.snap/snap-subdir-test 2024-08-31T12:16:12.680 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/30 file after the snapshot 2024-08-31T12:16:12.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/31 file after the snapshot 2024-08-31T12:16:12.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/32 file after the snapshot 2024-08-31T12:16:12.682 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/33 file after the snapshot 2024-08-31T12:16:12.683 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/34 file after the snapshot 2024-08-31T12:16:12.684 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/35 file after the snapshot 2024-08-31T12:16:12.685 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/36 file after the snapshot 2024-08-31T12:16:12.686 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/37 file after the snapshot 2024-08-31T12:16:12.687 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/38 file after the snapshot 2024-08-31T12:16:12.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 245/39 file after the snapshot 2024-08-31T12:16:12.689 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/.snap/snap-subdir-test 2024-08-31T12:16:12.704 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/30 file after the snapshot 2024-08-31T12:16:12.705 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/31 file after the snapshot 2024-08-31T12:16:12.706 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/32 file after the snapshot 2024-08-31T12:16:12.707 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/33 file after the snapshot 2024-08-31T12:16:12.708 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/34 file after the snapshot 2024-08-31T12:16:12.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/35 file after the snapshot 2024-08-31T12:16:12.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/36 file after the snapshot 2024-08-31T12:16:12.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/37 file after the snapshot 2024-08-31T12:16:12.712 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/38 file after the snapshot 2024-08-31T12:16:12.714 INFO:tasks.workunit.client.0.smithi164.stdout: create 246/39 file after the snapshot 2024-08-31T12:16:12.715 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/.snap/snap-subdir-test 2024-08-31T12:16:12.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/30 file after the snapshot 2024-08-31T12:16:12.735 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/31 file after the snapshot 2024-08-31T12:16:12.736 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/32 file after the snapshot 2024-08-31T12:16:12.739 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/33 file after the snapshot 2024-08-31T12:16:12.740 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/34 file after the snapshot 2024-08-31T12:16:12.741 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/35 file after the snapshot 2024-08-31T12:16:12.747 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/36 file after the snapshot 2024-08-31T12:16:12.749 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/37 file after the snapshot 2024-08-31T12:16:12.751 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/38 file after the snapshot 2024-08-31T12:16:12.753 INFO:tasks.workunit.client.0.smithi164.stdout: create 247/39 file after the snapshot 2024-08-31T12:16:12.755 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/.snap/snap-subdir-test 2024-08-31T12:16:12.773 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/30 file after the snapshot 2024-08-31T12:16:12.774 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/31 file after the snapshot 2024-08-31T12:16:12.776 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/32 file after the snapshot 2024-08-31T12:16:12.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 -- 172.21.15.164:0/1604055943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 msgr2=0x7f21b015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:12.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 --2- 172.21.15.164:0/1604055943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b015a370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f219c009840 tx=0x7f219c01c820 comp rx=0 tx=0).stop 2024-08-31T12:16:12.778 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/33 file after the snapshot 2024-08-31T12:16:12.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 -- 172.21.15.164:0/1604055943 shutdown_connections 2024-08-31T12:16:12.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 --2- 172.21.15.164:0/1604055943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b015a370 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:12.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 -- 172.21.15.164:0/1604055943 >> 172.21.15.164:0/1604055943 conn(0x7f21b0071be0 msgr2=0x7f21b006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:12.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 -- 172.21.15.164:0/1604055943 shutdown_connections 2024-08-31T12:16:12.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.774+0000 7f21b7800640 1 -- 172.21.15.164:0/1604055943 wait complete. 2024-08-31T12:16:12.779 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/34 file after the snapshot 2024-08-31T12:16:12.779 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/35 file after the snapshot 2024-08-31T12:16:12.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 Processor -- start 2024-08-31T12:16:12.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 -- start start 2024-08-31T12:16:12.780 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/36 file after the snapshot 2024-08-31T12:16:12.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b00c97e0 0x7f21b0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21b00cedf0 0x7f21b014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f21b01596f0 con 0x7f21b0159f60 2024-08-31T12:16:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21b00cf610 con 0x7f21b00c97e0 2024-08-31T12:16:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b7800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f21b00c5160 con 0x7f21b00cedf0 2024-08-31T12:16:12.784 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/37 file after the snapshot 2024-08-31T12:16:12.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44074/0 (socket says 172.21.15.164:44074) 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 -- 172.21.15.164:0/109303368 learned_addr learned my addr 172.21.15.164:0/109303368 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21afe00640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21b00cedf0 0x7f21b014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b4e00640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b00c97e0 0x7f21b0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 -- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21b00cedf0 msgr2=0x7f21b014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21b00cedf0 0x7f21b014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 -- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b00c97e0 msgr2=0x7f21b0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b00c97e0 0x7f21b0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.778+0000 7f21b5800640 1 -- 172.21.15.164:0/109303368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b0151750 con 0x7f21b0159f60 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21b5800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c6e0 tx=0x7f21a800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:12.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8003b80 con 0x7f21b0159f60 2024-08-31T12:16:12.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21a8003d20 con 0x7f21b0159f60 2024-08-31T12:16:12.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8005330 con 0x7f21b0159f60 2024-08-31T12:16:12.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b0150d60 con 0x7f21b0159f60 2024-08-31T12:16:12.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/38 file after the snapshot 2024-08-31T12:16:12.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b0151960 con 0x7f21b0159f60 2024-08-31T12:16:12.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 248/39 file after the snapshot 2024-08-31T12:16:12.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b00c5d30 con 0x7f21b0159f60 2024-08-31T12:16:12.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/.snap/snap-subdir-test 2024-08-31T12:16:12.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f21a80054d0 con 0x7f21b0159f60 2024-08-31T12:16:12.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 0x7f2190074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:12.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.782+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f21a8092be0 con 0x7f21b0159f60 2024-08-31T12:16:12.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.786+0000 7f21b4e00640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 0x7f2190074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:12.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.786+0000 7f21b4e00640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 0x7f2190074600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21a40046c0 tx=0x7f21a4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:12.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:12.790+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f21a805e170 con 0x7f21b0159f60 2024-08-31T12:16:12.801 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/30 file after the snapshot 2024-08-31T12:16:12.802 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/31 file after the snapshot 2024-08-31T12:16:12.803 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/32 file after the snapshot 2024-08-31T12:16:12.804 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/33 file after the snapshot 2024-08-31T12:16:12.805 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/34 file after the snapshot 2024-08-31T12:16:12.806 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/35 file after the snapshot 2024-08-31T12:16:12.807 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/36 file after the snapshot 2024-08-31T12:16:12.808 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/37 file after the snapshot 2024-08-31T12:16:12.809 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/38 file after the snapshot 2024-08-31T12:16:12.809 INFO:tasks.workunit.client.0.smithi164.stdout: create 249/39 file after the snapshot 2024-08-31T12:16:12.810 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/.snap/snap-subdir-test 2024-08-31T12:16:12.825 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/30 file after the snapshot 2024-08-31T12:16:12.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/31 file after the snapshot 2024-08-31T12:16:12.827 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/32 file after the snapshot 2024-08-31T12:16:12.828 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/33 file after the snapshot 2024-08-31T12:16:12.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/34 file after the snapshot 2024-08-31T12:16:12.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/35 file after the snapshot 2024-08-31T12:16:12.830 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/36 file after the snapshot 2024-08-31T12:16:12.831 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/37 file after the snapshot 2024-08-31T12:16:12.832 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/38 file after the snapshot 2024-08-31T12:16:12.833 INFO:tasks.workunit.client.0.smithi164.stdout: create 250/39 file after the snapshot 2024-08-31T12:16:12.834 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/.snap/snap-subdir-test 2024-08-31T12:16:13.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.006+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21b0156d10 con 0x7f21b0159f60 2024-08-31T12:16:13.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.006+0000 7f21acc00640 1 -- 172.21.15.164:0/109303368 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f21a805da70 con 0x7f21b0159f60 2024-08-31T12:16:13.011 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:13.011 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:13.012 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 msgr2=0x7f2190074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 0x7f2190074600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21a40046c0 tx=0x7f21a4009040 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 msgr2=0x7f21b00cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c6e0 tx=0x7f21a800cba0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 shutdown_connections 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21900720f0 0x7f2190074600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21b0159f60 0x7f21b00cdc90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21b00cedf0 0x7f21b014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 --2- 172.21.15.164:0/109303368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b00c97e0 0x7f21b0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 >> 172.21.15.164:0/109303368 conn(0x7f21b0071be0 msgr2=0x7f21b0152850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 shutdown_connections 2024-08-31T12:16:13.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.010+0000 7f21b7800640 1 -- 172.21.15.164:0/109303368 wait complete. 2024-08-31T12:16:13.032 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=0) 2024-08-31T12:16:13.032 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-31T12:16:13.032 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:16:13.091 INFO:tasks.ceph.mds.a:Stopped 2024-08-31T12:16:13.092 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:13.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 -- 172.21.15.164:0/2465166183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 msgr2=0x7f1668152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 --2- 172.21.15.164:0/2465166183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f1668152a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1658009840 tx=0x7f165801f010 comp rx=0 tx=0).stop 2024-08-31T12:16:13.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 -- 172.21.15.164:0/2465166183 shutdown_connections 2024-08-31T12:16:13.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 --2- 172.21.15.164:0/2465166183 >> v2:172.21.15.184:3300/0 conn(0x7f16680c9330 0x7f1668074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 --2- 172.21.15.164:0/2465166183 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f1668152a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 -- 172.21.15.164:0/2465166183 >> 172.21.15.164:0/2465166183 conn(0x7f16680ccf20 msgr2=0x7f16680cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:13.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 -- 172.21.15.164:0/2465166183 shutdown_connections 2024-08-31T12:16:13.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.286+0000 7f1670800640 1 -- 172.21.15.164:0/2465166183 wait complete. 2024-08-31T12:16:13.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 Processor -- start 2024-08-31T12:16:13.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- start start 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f16681e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 0x7f166814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f16680c8030 con 0x7f166815bc70 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f16680c3150 con 0x7f16680c9330 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1668074c60 con 0x7f16680c1f40 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44076/0 (socket says 172.21.15.164:44076) 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 -- 172.21.15.164:0/468951136 learned_addr learned my addr 172.21.15.164:0/468951136 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166de00640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f16681e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166d400640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 0x7f166814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 -- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 msgr2=0x7f16681e5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f16681e5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 -- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 msgr2=0x7f166814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 0x7f166814cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 -- 172.21.15.164:0/468951136 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166814d070 con 0x7f166815bc70 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166d400640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 0x7f166814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f166e800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f166400eae0 tx=0x7f1664009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166400ce40 con 0x7f166815bc70 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1664004c20 con 0x7f166815bc70 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681e6410 con 0x7f166815bc70 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664005020 con 0x7f166815bc70 2024-08-31T12:16:13.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.290+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681e69d0 con 0x7f166815bc70 2024-08-31T12:16:13.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.294+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1668152a10 con 0x7f166815bc70 2024-08-31T12:16:13.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.294+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f16640051c0 con 0x7f166815bc70 2024-08-31T12:16:13.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.294+0000 7f1662000640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 0x7f164c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:13.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.294+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f1664093c90 con 0x7f166815bc70 2024-08-31T12:16:13.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.294+0000 7f166de00640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 0x7f164c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:13.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.298+0000 7f166de00640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 0x7f164c0745d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f165c007fd0 tx=0x7f165c007ea0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:13.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.298+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f166405f220 con 0x7f166815bc70 2024-08-31T12:16:13.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.498+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16681560a0 con 0x7f166815bc70 2024-08-31T12:16:13.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.498+0000 7f1662000640 1 -- 172.21.15.164:0/468951136 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f166405eb20 con 0x7f166815bc70 2024-08-31T12:16:13.502 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:13.502 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:13.503 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 msgr2=0x7f164c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 0x7f164c0745d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f165c007fd0 tx=0x7f165c007ea0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 msgr2=0x7f16681e3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f166400eae0 tx=0x7f1664009f70 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 shutdown_connections 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f164c0720c0 0x7f164c0745d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f166815bc70 0x7f16681e3ce0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16680c9330 0x7f166814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 --2- 172.21.15.164:0/468951136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16680c1f40 0x7f16681e5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 >> 172.21.15.164:0/468951136 conn(0x7f16680ccf20 msgr2=0x7f166814fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 shutdown_connections 2024-08-31T12:16:13.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:13.502+0000 7f1670800640 1 -- 172.21.15.164:0/468951136 wait complete. 2024-08-31T12:16:13.524 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:15.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 -- 172.21.15.164:0/16534894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c15bc70 msgr2=0x7f851c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 --2- 172.21.15.164:0/16534894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c15bc70 0x7f851c152a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f850c009c80 tx=0x7f850c01f5a0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 -- 172.21.15.164:0/16534894 shutdown_connections 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 --2- 172.21.15.164:0/16534894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0c9330 0x7f851c074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 --2- 172.21.15.164:0/16534894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c15bc70 0x7f851c152a10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 -- 172.21.15.164:0/16534894 >> 172.21.15.164:0/16534894 conn(0x7f851c0ccf20 msgr2=0x7f851c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 -- 172.21.15.164:0/16534894 shutdown_connections 2024-08-31T12:16:15.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.686+0000 7f8523800640 1 -- 172.21.15.164:0/16534894 wait complete. 2024-08-31T12:16:15.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 Processor -- start 2024-08-31T12:16:15.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 -- start start 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0c1f40 0x7f851c1f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 0x7f851c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f851c0c8030 con 0x7f851c0c9330 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f851c0c3150 con 0x7f851c0c1f40 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8523800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f851c074c60 con 0x7f851c15bc70 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41094/0 (socket says 172.21.15.164:41094) 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 -- 172.21.15.164:0/2903993819 learned_addr learned my addr 172.21.15.164:0/2903993819 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:15.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8520e00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0c1f40 0x7f851c1f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8521800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 0x7f851c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 -- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 msgr2=0x7f851c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 0x7f851c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 -- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0c1f40 msgr2=0x7f851c1f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0c1f40 0x7f851c1f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 -- 172.21.15.164:0/2903993819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c1f6070 con 0x7f851c0c9330 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f8521800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 0x7f851c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:15.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.690+0000 7f851be00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f850800c3f0 tx=0x7f850800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508017070 con 0x7f851c0c9330 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85080053c0 con 0x7f851c0c9330 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508003860 con 0x7f851c0c9330 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c157140 con 0x7f851c0c9330 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c1f2c60 con 0x7f851c0c9330 2024-08-31T12:16:15.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851c074720 con 0x7f851c0c9330 2024-08-31T12:16:15.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.694+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f850801a070 con 0x7f851c0c9330 2024-08-31T12:16:15.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.698+0000 7f8518c00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 0x7f84fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:15.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.698+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f8508092280 con 0x7f851c0c9330 2024-08-31T12:16:15.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.698+0000 7f8520e00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 0x7f84fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:15.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.698+0000 7f8520e00640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 0x7f84fc0745d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b3000 tx=0x7f850c01dde0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:15.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.702+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f850805d130 con 0x7f851c0c9330 2024-08-31T12:16:15.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.898+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f851c1f5490 con 0x7f851c0c9330 2024-08-31T12:16:15.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.898+0000 7f8518c00640 1 -- 172.21.15.164:0/2903993819 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f85080618f0 con 0x7f851c0c9330 2024-08-31T12:16:15.901 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:15.901 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:15.901 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.898+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 msgr2=0x7f84fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.898+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 0x7f84fc0745d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b3000 tx=0x7f850c01dde0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 msgr2=0x7f851c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f850800c3f0 tx=0x7f850800c8b0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 shutdown_connections 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f84fc0720c0 0x7f84fc0745d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c15bc70 0x7f851c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f851c0c9330 0x7f851c151550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 --2- 172.21.15.164:0/2903993819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0c1f40 0x7f851c1f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:15.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 >> 172.21.15.164:0/2903993819 conn(0x7f851c0ccf20 msgr2=0x7f851c070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:15.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 shutdown_connections 2024-08-31T12:16:15.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:15.902+0000 7f8523800640 1 -- 172.21.15.164:0/2903993819 wait complete. 2024-08-31T12:16:15.923 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:17.923 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 -- 172.21.15.164:0/3435491232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac074e20 msgr2=0x7f2eac156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 --2- 172.21.15.164:0/3435491232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac074e20 0x7f2eac156e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2eac070ba0 tx=0x7f2ea001f580 comp rx=0 tx=0).stop 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 -- 172.21.15.164:0/3435491232 shutdown_connections 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 --2- 172.21.15.164:0/3435491232 >> v2:172.21.15.184:3300/0 conn(0x7f2eac15d220 0x7f2eac164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 --2- 172.21.15.164:0/3435491232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac074e20 0x7f2eac156e10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 -- 172.21.15.164:0/3435491232 >> 172.21.15.164:0/3435491232 conn(0x7f2eac0ccf20 msgr2=0x7f2eac0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:18.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 -- 172.21.15.164:0/3435491232 shutdown_connections 2024-08-31T12:16:18.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.086+0000 7f2eb4400640 1 -- 172.21.15.164:0/3435491232 wait complete. 2024-08-31T12:16:18.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 Processor -- start 2024-08-31T12:16:18.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- start start 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac074e20 0x7f2eac15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 0x7f2eac1f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac159c90 con 0x7f2eac15ce10 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1599b0 con 0x7f2eac074e20 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac159f70 con 0x7f2eac15d220 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:18.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41118/0 (socket says 172.21.15.164:41118) 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 -- 172.21.15.164:0/4266525343 learned_addr learned my addr 172.21.15.164:0/4266525343 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1a00640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac074e20 0x7f2eac15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb2400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 0x7f2eac1f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 -- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 msgr2=0x7f2eac1f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 0x7f2eac1f3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 -- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac074e20 msgr2=0x7f2eac15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac074e20 0x7f2eac15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 -- 172.21.15.164:0/4266525343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac1f3790 con 0x7f2eac15ce10 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb2400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 0x7f2eac1f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb1000640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c420 tx=0x7f2e9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98017070 con 0x7f2eac15ce10 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac149590 con 0x7f2eac15ce10 2024-08-31T12:16:18.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e980053c0 con 0x7f2eac15ce10 2024-08-31T12:16:18.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98003860 con 0x7f2eac15ce10 2024-08-31T12:16:18.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.090+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac15ab30 con 0x7f2eac15ce10 2024-08-31T12:16:18.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac071e40 con 0x7f2eac15ce10 2024-08-31T12:16:18.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2e9801a070 con 0x7f2eac15ce10 2024-08-31T12:16:18.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2ea9600640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 0x7f2e8c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:18.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f2e980921b0 con 0x7f2eac15ce10 2024-08-31T12:16:18.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2eb1a00640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 0x7f2e8c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:18.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.094+0000 7f2eb1a00640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 0x7f2e8c074600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00b3000 tx=0x7f2ea001ddc0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:18.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.098+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2e9805d070 con 0x7f2eac15ce10 2024-08-31T12:16:18.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.298+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eac074c00 con 0x7f2eac15ce10 2024-08-31T12:16:18.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.298+0000 7f2ea9600640 1 -- 172.21.15.164:0/4266525343 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f2e98061830 con 0x7f2eac15ce10 2024-08-31T12:16:18.302 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:18.303 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:18.303 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 msgr2=0x7f2e8c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 0x7f2e8c074600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00b3000 tx=0x7f2ea001ddc0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 msgr2=0x7f2eac14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c420 tx=0x7f2e9800c8e0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 shutdown_connections 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2e8c0720f0 0x7f2e8c074600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15d220 0x7f2eac1f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2eac15ce10 0x7f2eac14fae0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 --2- 172.21.15.164:0/4266525343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac074e20 0x7f2eac15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 >> 172.21.15.164:0/4266525343 conn(0x7f2eac0ccf20 msgr2=0x7f2eac1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 shutdown_connections 2024-08-31T12:16:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:18.302+0000 7f2eb4400640 1 -- 172.21.15.164:0/4266525343 wait complete. 2024-08-31T12:16:18.325 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:20.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:20.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 -- 172.21.15.164:0/1291219460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c9330 msgr2=0x7f4100074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:20.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 --2- 172.21.15.164:0/1291219460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c9330 0x7f4100074720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009900 tx=0x7f40f801f0d0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 -- 172.21.15.164:0/1291219460 shutdown_connections 2024-08-31T12:16:20.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 --2- 172.21.15.164:0/1291219460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c9330 0x7f4100074720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 --2- 172.21.15.164:0/1291219460 >> v2:172.21.15.184:3300/0 conn(0x7f410015bc70 0x7f4100152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 -- 172.21.15.164:0/1291219460 >> 172.21.15.164:0/1291219460 conn(0x7f41000ccf20 msgr2=0x7f41000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:20.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 -- 172.21.15.164:0/1291219460 shutdown_connections 2024-08-31T12:16:20.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.490+0000 7f4104e00640 1 -- 172.21.15.164:0/1291219460 wait complete. 2024-08-31T12:16:20.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 Processor -- start 2024-08-31T12:16:20.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- start start 2024-08-31T12:16:20.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c1f40 0x7f41001f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:20.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:20.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 0x7f410015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f41000c8030 con 0x7f41000c9330 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f41000c3150 con 0x7f410015bc70 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4100074c60 con 0x7f41000c1f40 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41124/0 (socket says 172.21.15.164:41124) 2024-08-31T12:16:20.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 -- 172.21.15.164:0/1259684229 learned_addr learned my addr 172.21.15.164:0/1259684229 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40fde00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c1f40 0x7f41001f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40fe800640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 0x7f410015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 -- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c1f40 msgr2=0x7f41001f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c1f40 0x7f41001f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 -- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 msgr2=0x7f410015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 0x7f410015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 -- 172.21.15.164:0/1259684229 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41000af4f0 con 0x7f41000c9330 2024-08-31T12:16:20.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40fe800640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 0x7f410015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f5400640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c3c0 tx=0x7f40e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8017070 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40e80053c0 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8003860 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41001f5a20 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.494+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41001f5fe0 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.498+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4100074720 con 0x7f41000c9330 2024-08-31T12:16:20.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.498+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f40e801a070 con 0x7f41000c9330 2024-08-31T12:16:20.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.498+0000 7f40f6a00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 0x7f40dc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:20.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.498+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f40e80921f0 con 0x7f41000c9330 2024-08-31T12:16:20.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.498+0000 7f40fde00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 0x7f40dc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:20.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.502+0000 7f40fde00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 0x7f40dc074600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009980 tx=0x7f40f0009500 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:20.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.502+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f40e805d0b0 con 0x7f41000c9330 2024-08-31T12:16:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.702+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41001560a0 con 0x7f41000c9330 2024-08-31T12:16:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.702+0000 7f40f6a00640 1 -- 172.21.15.164:0/1259684229 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f40e8061870 con 0x7f41000c9330 2024-08-31T12:16:20.705 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:20.705 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 msgr2=0x7f40dc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 0x7f40dc074600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009980 tx=0x7f40f0009500 comp rx=0 tx=0).stop 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 msgr2=0x7f410014fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c3c0 tx=0x7f40e800c880 comp rx=0 tx=0).stop 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 shutdown_connections 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f40dc0720f0 0x7f40dc074600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f410015bc70 0x7f410015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41000c9330 0x7f410014fbf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 --2- 172.21.15.164:0/1259684229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41000c1f40 0x7f41001f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 >> 172.21.15.164:0/1259684229 conn(0x7f41000ccf20 msgr2=0x7f41000b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 shutdown_connections 2024-08-31T12:16:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:20.706+0000 7f4104e00640 1 -- 172.21.15.164:0/1259684229 wait complete. 2024-08-31T12:16:20.726 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:22.727 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:22.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 -- 172.21.15.164:0/743780782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40180c1f40 msgr2=0x7f4018152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:22.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 --2- 172.21.15.164:0/743780782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40180c1f40 0x7f4018152a10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4000009840 tx=0x7f400001f010 comp rx=0 tx=0).stop 2024-08-31T12:16:22.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 -- 172.21.15.164:0/743780782 shutdown_connections 2024-08-31T12:16:22.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 --2- 172.21.15.164:0/743780782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40180c1f40 0x7f4018152a10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:22.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 -- 172.21.15.164:0/743780782 >> 172.21.15.164:0/743780782 conn(0x7f40180ccf20 msgr2=0x7f40180cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:22.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 -- 172.21.15.164:0/743780782 shutdown_connections 2024-08-31T12:16:22.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.894+0000 7f401f000640 1 -- 172.21.15.164:0/743780782 wait complete. 2024-08-31T12:16:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 Processor -- start 2024-08-31T12:16:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- start start 2024-08-31T12:16:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180c1f40 0x7f401815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180c9330 0x7f40181e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c8030 con 0x7f401815bc70 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c3150 con 0x7f40180c9330 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4018074e30 con 0x7f40180c1f40 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f4017e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180c1f40 0x7f401815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41136/0 (socket says 172.21.15.164:41136) 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 -- 172.21.15.164:0/1438767767 learned_addr learned my addr 172.21.15.164:0/1438767767 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f400f400640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180c9330 0x7f40181e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 -- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180c1f40 msgr2=0x7f401815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180c1f40 0x7f401815aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 -- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180c9330 msgr2=0x7f40181e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180c9330 0x7f40181e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 -- 172.21.15.164:0/1438767767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401815af60 con 0x7f401815bc70 2024-08-31T12:16:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401d000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f401000c340 tx=0x7f401000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010017070 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40100053c0 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010003860 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40180b25c0 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.898+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4018159c60 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.902+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4018152a10 con 0x7f401815bc70 2024-08-31T12:16:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.902+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f401001a070 con 0x7f401815bc70 2024-08-31T12:16:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.902+0000 7f4014c00640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 0x7f3ff4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.902+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f4010092300 con 0x7f401815bc70 2024-08-31T12:16:22.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.902+0000 7f4017e00640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 0x7f3ff4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:22.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.906+0000 7f4017e00640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 0x7f3ff4074600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40080017b0 tx=0x7f4008001740 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:22.906+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f401005d120 con 0x7f401815bc70 2024-08-31T12:16:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40180c72a0 con 0x7f401815bc70 2024-08-31T12:16:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f4014c00640 1 -- 172.21.15.164:0/1438767767 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f40100618e0 con 0x7f401815bc70 2024-08-31T12:16:23.109 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:23.109 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 msgr2=0x7f3ff4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 0x7f3ff4074600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40080017b0 tx=0x7f4008001740 comp rx=0 tx=0).stop 2024-08-31T12:16:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 msgr2=0x7f4018153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.106+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f401000c340 tx=0x7f401000c800 comp rx=0 tx=0).stop 2024-08-31T12:16:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 shutdown_connections 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3ff40720f0 0x7f3ff4074600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f401815bc70 0x7f4018153680 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180c9330 0x7f40181e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 --2- 172.21.15.164:0/1438767767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180c1f40 0x7f401815aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 >> 172.21.15.164:0/1438767767 conn(0x7f40180ccf20 msgr2=0x7f4018151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 shutdown_connections 2024-08-31T12:16:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:23.110+0000 7f401f000640 1 -- 172.21.15.164:0/1438767767 wait complete. 2024-08-31T12:16:23.130 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:25.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 -- 172.21.15.164:0/3039770757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a80c1f40 msgr2=0x7f94a80c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 --2- 172.21.15.164:0/3039770757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a80c1f40 0x7f94a80c9330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94a8072540 tx=0x7f949801f0b0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 -- 172.21.15.164:0/3039770757 shutdown_connections 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 --2- 172.21.15.164:0/3039770757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 --2- 172.21.15.164:0/3039770757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a80c1f40 0x7f94a80c9330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 --2- 172.21.15.164:0/3039770757 >> v2:172.21.15.184:3300/0 conn(0x7f94a815bc70 0x7f94a8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 -- 172.21.15.164:0/3039770757 >> 172.21.15.164:0/3039770757 conn(0x7f94a80ccf20 msgr2=0x7f94a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 -- 172.21.15.164:0/3039770757 shutdown_connections 2024-08-31T12:16:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.294+0000 7f94b0800640 1 -- 172.21.15.164:0/3039770757 wait complete. 2024-08-31T12:16:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 Processor -- start 2024-08-31T12:16:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- start start 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a80c1f40 0x7f94a815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a815b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80748a0 con 0x7f94a815bc70 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f94a8074720 con 0x7f94a80c1f40 2024-08-31T12:16:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f94a8074a20 con 0x7f94a80c7920 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41144/0 (socket says 172.21.15.164:41144) 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 -- 172.21.15.164:0/1090178414 learned_addr learned my addr 172.21.15.164:0/1090178414 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ade00640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a80c1f40 0x7f94a815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ad400640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 -- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 msgr2=0x7f94a815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 -- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a80c1f40 msgr2=0x7f94a815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a80c1f40 0x7f94a815a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 -- 172.21.15.164:0/1090178414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a80cbfb0 con 0x7f94a815bc70 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ad400640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94ae800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e990 tx=0x7f94a400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004d30 con 0x7f94a815bc70 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94a400caa0 con 0x7f94a815bc70 2024-08-31T12:16:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4005020 con 0x7f94a815bc70 2024-08-31T12:16:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a80caf70 con 0x7f94a815bc70 2024-08-31T12:16:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.298+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a81f5820 con 0x7f94a815bc70 2024-08-31T12:16:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.302+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a80cc490 con 0x7f94a815bc70 2024-08-31T12:16:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.302+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f94a40051c0 con 0x7f94a815bc70 2024-08-31T12:16:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.302+0000 7f94a2000640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 0x7f948c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.302+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f94a4093690 con 0x7f94a815bc70 2024-08-31T12:16:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.302+0000 7f94ade00640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 0x7f948c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:25.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.306+0000 7f94ade00640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 0x7f948c0745d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f949c00bb50 tx=0x7f949c00b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:25.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.306+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f94a4016030 con 0x7f94a815bc70 2024-08-31T12:16:25.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.506+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94a8074f10 con 0x7f94a815bc70 2024-08-31T12:16:25.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94a2000640 1 -- 172.21.15.164:0/1090178414 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f94a4067040 con 0x7f94a815bc70 2024-08-31T12:16:25.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:25.511 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:25.512 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 msgr2=0x7f948c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 0x7f948c0745d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f949c00bb50 tx=0x7f949c00b2e0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 msgr2=0x7f94a8150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e990 tx=0x7f94a400ee50 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 shutdown_connections 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f948c0720c0 0x7f948c0745d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a815bc70 0x7f94a8150f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a80c7920 0x7f94a815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 --2- 172.21.15.164:0/1090178414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a80c1f40 0x7f94a815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 >> 172.21.15.164:0/1090178414 conn(0x7f94a80ccf20 msgr2=0x7f94a815c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 shutdown_connections 2024-08-31T12:16:25.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:25.510+0000 7f94b0800640 1 -- 172.21.15.164:0/1090178414 wait complete. 2024-08-31T12:16:25.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:27.535 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.698+0000 7f6fba800640 1 -- 172.21.15.164:0/4141190230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 msgr2=0x7f6fb40c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.698+0000 7f6fba800640 1 --2- 172.21.15.164:0/4141190230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb40c92b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009c80 tx=0x7f6fac01f560 comp rx=0 tx=0).stop 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- 172.21.15.164:0/4141190230 shutdown_connections 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- 172.21.15.164:0/4141190230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb40c92b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- 172.21.15.164:0/4141190230 >> v2:172.21.15.184:3300/0 conn(0x7f6fb415ce10 0x7f6fb40c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- 172.21.15.164:0/4141190230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb4074e20 0x7f6fb4156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- 172.21.15.164:0/4141190230 >> 172.21.15.164:0/4141190230 conn(0x7f6fb40ccf20 msgr2=0x7f6fb40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:27.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- 172.21.15.164:0/4141190230 shutdown_connections 2024-08-31T12:16:27.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- 172.21.15.164:0/4141190230 wait complete. 2024-08-31T12:16:27.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 Processor -- start 2024-08-31T12:16:27.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- start start 2024-08-31T12:16:27.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fb4074e20 0x7f6fb41f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:27.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb415ce10 0x7f6fb4155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:27.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4159c90 con 0x7f6fb415d220 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41599b0 con 0x7f6fb4074e20 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fba800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb4159f70 con 0x7f6fb415ce10 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.702+0000 7f6fb3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47026/0 (socket says 172.21.15.164:47026) 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 -- 172.21.15.164:0/1547984609 learned_addr learned my addr 172.21.15.164:0/1547984609 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3400640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fb4074e20 0x7f6fb41f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:27.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6faaa00640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb415ce10 0x7f6fb4155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 -- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb415ce10 msgr2=0x7f6fb4155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb415ce10 0x7f6fb4155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 -- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fb4074e20 msgr2=0x7f6fb41f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fb4074e20 0x7f6fb41f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 -- 172.21.15.164:0/1547984609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb41f0c20 con 0x7f6fb415d220 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fb3e00640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6fac026270 tx=0x7f6fac009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b6040 con 0x7f6fb415d220 2024-08-31T12:16:27.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fac004c50 con 0x7f6fb415d220 2024-08-31T12:16:27.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b1b40 con 0x7f6fb415d220 2024-08-31T12:16:27.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb40ccb80 con 0x7f6fb415d220 2024-08-31T12:16:27.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb41efee0 con 0x7f6fb415d220 2024-08-31T12:16:27.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb40cc400 con 0x7f6fb415d220 2024-08-31T12:16:27.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.706+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6fac0b1ce0 con 0x7f6fb415d220 2024-08-31T12:16:27.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.710+0000 7f6fabe00640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 0x7f6f900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:27.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.710+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f6fac1319c0 con 0x7f6fb415d220 2024-08-31T12:16:27.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.710+0000 7f6fb3400640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 0x7f6f900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:27.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.710+0000 7f6fb3400640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 0x7f6f900745d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005fd0 tx=0x7f6fa4005d80 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:27.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.710+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6fb40cc400 con 0x7f6fb415d220 2024-08-31T12:16:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.910+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fb4071e40 con 0x7f6fb415d220 2024-08-31T12:16:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.910+0000 7f6fabe00640 1 -- 172.21.15.164:0/1547984609 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f6fac0ab070 con 0x7f6fb415d220 2024-08-31T12:16:27.914 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:27.914 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 msgr2=0x7f6f900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 0x7f6f900745d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005fd0 tx=0x7f6fa4005d80 comp rx=0 tx=0).stop 2024-08-31T12:16:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 msgr2=0x7f6fb4157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6fac026270 tx=0x7f6fac009350 comp rx=0 tx=0).stop 2024-08-31T12:16:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 shutdown_connections 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6f900720c0 0x7f6f900745d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb415d220 0x7f6fb4157ee0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fb415ce10 0x7f6fb4155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 --2- 172.21.15.164:0/1547984609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fb4074e20 0x7f6fb41f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 >> 172.21.15.164:0/1547984609 conn(0x7f6fb40ccf20 msgr2=0x7f6fb40c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 shutdown_connections 2024-08-31T12:16:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:27.914+0000 7f6fba800640 1 -- 172.21.15.164:0/1547984609 wait complete. 2024-08-31T12:16:27.936 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:29.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:30.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 -- 172.21.15.164:0/407044524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fd4004810 msgr2=0x7f5fd4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:30.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 --2- 172.21.15.164:0/407044524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fd4004810 0x7f5fd4004c20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009b40 tx=0x7f5fd801d250 comp rx=0 tx=0).stop 2024-08-31T12:16:30.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 -- 172.21.15.164:0/407044524 shutdown_connections 2024-08-31T12:16:30.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 --2- 172.21.15.164:0/407044524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fd4004810 0x7f5fd4004c20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 -- 172.21.15.164:0/407044524 >> 172.21.15.164:0/407044524 conn(0x7f5ff00ccf20 msgr2=0x7f5ff00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:30.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 -- 172.21.15.164:0/407044524 shutdown_connections 2024-08-31T12:16:30.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 -- 172.21.15.164:0/407044524 wait complete. 2024-08-31T12:16:30.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.094+0000 7f5ff5400640 1 Processor -- start 2024-08-31T12:16:30.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- start start 2024-08-31T12:16:30.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fd4004810 0x7f5ff01edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:30.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff0073c60 0x7f5ff015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:30.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:30.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0152a10 con 0x7f5ff015b160 2024-08-31T12:16:30.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00c3150 con 0x7f5fd4004810 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff0152b90 con 0x7f5ff0073c60 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fee800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fd4004810 0x7f5ff01edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47052/0 (socket says 172.21.15.164:47052) 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fe5e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff0073c60 0x7f5ff015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 -- 172.21.15.164:0/2514943876 learned_addr learned my addr 172.21.15.164:0/2514943876 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 -- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff0073c60 msgr2=0x7f5ff015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff0073c60 0x7f5ff015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 -- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fd4004810 msgr2=0x7f5ff01edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fd4004810 0x7f5ff01edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 -- 172.21.15.164:0/2514943876 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff01ee520 con 0x7f5ff015b160 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fef200640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c75e0 tx=0x7f5fe800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:30.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8018070 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fe8003980 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff01edb00 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8003db0 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01563f0 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.098+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff015b9e0 con 0x7f5ff015b160 2024-08-31T12:16:30.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.102+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5fe801b070 con 0x7f5ff015b160 2024-08-31T12:16:30.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.102+0000 7f5fe7400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 0x7f5fcc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:30.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.102+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6646+0+0 (secure 0 0 0) 0x7f5fe8092480 con 0x7f5ff015b160 2024-08-31T12:16:30.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.102+0000 7f5fee800640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 0x7f5fcc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:30.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.106+0000 7f5fee800640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 0x7f5fcc074600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001870 tx=0x7f5fe0006040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:30.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.106+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5fe805d3c0 con 0x7f5ff015b160 2024-08-31T12:16:30.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.306+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ff00c7920 con 0x7f5ff015b160 2024-08-31T12:16:30.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.306+0000 7f5fe7400640 1 -- 172.21.15.164:0/2514943876 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6888 (secure 0 0 0) 0x7f5fe8061b80 con 0x7f5ff015b160 2024-08-31T12:16:30.310 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:30.310 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"btime":"2024-08-31T12:14:11:645226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:14:11.045699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6835/2031819890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2031819890},{"type":"v1","addr":"172.21.15.164:6835","nonce":2031819890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-08-31T12:16:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 msgr2=0x7f5fcc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 0x7f5fcc074600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001870 tx=0x7f5fe0006040 comp rx=0 tx=0).stop 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 msgr2=0x7f5ff014b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c75e0 tx=0x7f5fe800db60 comp rx=0 tx=0).stop 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 shutdown_connections 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f5fcc0720f0 0x7f5fcc074600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ff015b160 0x7f5ff014b6d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff0073c60 0x7f5ff015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 --2- 172.21.15.164:0/2514943876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fd4004810 0x7f5ff01edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:30.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 >> 172.21.15.164:0/2514943876 conn(0x7f5ff00ccf20 msgr2=0x7f5ff0151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:30.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 shutdown_connections 2024-08-31T12:16:30.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:30.310+0000 7f5ff5400640 1 -- 172.21.15.164:0/2514943876 wait complete. 2024-08-31T12:16:30.331 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:16:32.332 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 -- 172.21.15.164:0/1587275386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aec004810 msgr2=0x7f8aec004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 --2- 172.21.15.164:0/1587275386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aec004810 0x7f8aec004c20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c660 tx=0x7f8af001fa40 comp rx=0 tx=0).stop 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 -- 172.21.15.164:0/1587275386 shutdown_connections 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 --2- 172.21.15.164:0/1587275386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aec004810 0x7f8aec004c20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 -- 172.21.15.164:0/1587275386 >> 172.21.15.164:0/1587275386 conn(0x7f8b08071a40 msgr2=0x7f8b0806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 -- 172.21.15.164:0/1587275386 shutdown_connections 2024-08-31T12:16:32.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.486+0000 7f8b0e200640 1 -- 172.21.15.164:0/1587275386 wait complete. 2024-08-31T12:16:32.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 Processor -- start 2024-08-31T12:16:32.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 -- start start 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8aec004810 0x7f8b08148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 0x7f8b080c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8b080c5250 con 0x7f8b081f24d0 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b080c50d0 con 0x7f8aec004810 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b0e200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8b080c53d0 con 0x7f8b08148e20 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47068/0 (socket says 172.21.15.164:47068) 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 -- 172.21.15.164:0/4068885623 learned_addr learned my addr 172.21.15.164:0/4068885623 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b07400640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8aec004810 0x7f8b08148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b07e00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 0x7f8b080c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 -- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 msgr2=0x7f8b080c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 0x7f8b080c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 -- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8aec004810 msgr2=0x7f8b08148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8aec004810 0x7f8b08148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 -- 172.21.15.164:0/4068885623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0815ac60 con 0x7f8b081f24d0 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8b07e00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 0x7f8b080c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8afea00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8af009c330 tx=0x7f8af000c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.490+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0001840 con 0x7f8b081f24d0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8af00019e0 con 0x7f8b081f24d0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003be0 con 0x7f8b081f24d0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0806f910 con 0x7f8b081f24d0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b08149e60 con 0x7f8b081f24d0 2024-08-31T12:16:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b08153df0 con 0x7f8b081f24d0 2024-08-31T12:16:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8af00a9610 con 0x7f8b081f24d0 2024-08-31T12:16:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8affe00640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f8af01300c0 con 0x7f8b081f24d0 2024-08-31T12:16:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.494+0000 7f8b07400640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.498+0000 7f8b07400640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b0806b990 tx=0x7f8af80091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.498+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8af00197f0 con 0x7f8b081f24d0 2024-08-31T12:16:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.698+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b080cda30 con 0x7f8b081f24d0 2024-08-31T12:16:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.698+0000 7f8affe00640 1 -- 172.21.15.164:0/4068885623 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6056 (secure 0 0 0) 0x7f8af00faf60 con 0x7f8b081f24d0 2024-08-31T12:16:32.702 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:32.702 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":11,"btime":"2024-08-31T12:16:31:307961+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:31.307955+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 11 2024-08-31T12:16:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 msgr2=0x7f8ae4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b0806b990 tx=0x7f8af80091e0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 msgr2=0x7f8b080c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8af009c330 tx=0x7f8af000c2a0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 shutdown_connections 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b08148e20 0x7f8b080c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b081f24d0 0x7f8b080c7e90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 --2- 172.21.15.164:0/4068885623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8aec004810 0x7f8b08148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 >> 172.21.15.164:0/4068885623 conn(0x7f8b08071a40 msgr2=0x7f8b08152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 shutdown_connections 2024-08-31T12:16:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.702+0000 7f8b0e200640 1 -- 172.21.15.164:0/4068885623 wait complete. 2024-08-31T12:16:32.723 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-08-31T12:16:32.723 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-08-31T12:16:32.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 -- 172.21.15.164:0/3070142379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c40c3f70 msgr2=0x7f21c4153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 --2- 172.21.15.164:0/3070142379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c40c3f70 0x7f21c4153650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009900 tx=0x7f21ac01c8e0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 -- 172.21.15.164:0/3070142379 shutdown_connections 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 --2- 172.21.15.164:0/3070142379 >> v2:172.21.15.184:3300/0 conn(0x7f21c4153b90 0x7f21c4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 --2- 172.21.15.164:0/3070142379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c40c3f70 0x7f21c4153650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.874+0000 7f21ca600640 1 -- 172.21.15.164:0/3070142379 >> 172.21.15.164:0/3070142379 conn(0x7f21c40717b0 msgr2=0x7f21c4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- 172.21.15.164:0/3070142379 shutdown_connections 2024-08-31T12:16:32.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- 172.21.15.164:0/3070142379 wait complete. 2024-08-31T12:16:32.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 Processor -- start 2024-08-31T12:16:32.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- start start 2024-08-31T12:16:32.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 0x7f21c413ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c4153b90 0x7f21c4142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40c4380 con 0x7f21c40c3f70 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21c415a3c0 con 0x7f21c40c4760 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.878+0000 7f21ca600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40b2aa0 con 0x7f21c4153b90 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47084/0 (socket says 172.21.15.164:47084) 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 -- 172.21.15.164:0/2961886030 learned_addr learned my addr 172.21.15.164:0/2961886030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21baa00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 0x7f21c413ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3e00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c4153b90 0x7f21c4142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 -- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c4153b90 msgr2=0x7f21c4142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c4153b90 0x7f21c4142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 -- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 msgr2=0x7f21c413ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 0x7f21c413ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 -- 172.21.15.164:0/2961886030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c413e2a0 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21baa00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 0x7f21c413ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21c3400640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c420 tx=0x7f21b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b40052d0 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21b4007020 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41634a0 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4007470 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c4163a60 con 0x7f21c40c3f70 2024-08-31T12:16:32.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c4153650 con 0x7f21c40c3f70 2024-08-31T12:16:32.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.882+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f21b40067e0 con 0x7f21c40c3f70 2024-08-31T12:16:32.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.886+0000 7f21bbe00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 0x7f21a0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:32.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.886+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f21b40922a0 con 0x7f21c40c3f70 2024-08-31T12:16:32.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.886+0000 7f21baa00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 0x7f21a0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:32.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.886+0000 7f21baa00640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 0x7f21a0074600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009900 tx=0x7f21ac01b120 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:32.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:32.890+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f21b4001090 con 0x7f21c40c3f70 2024-08-31T12:16:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.086+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21c4157270 con 0x7f21c40c3f70 2024-08-31T12:16:33.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21bbe00640 1 -- 172.21.15.164:0/2961886030 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6056 (secure 0 0 0) 0x7f21b405d1c0 con 0x7f21c40c3f70 2024-08-31T12:16:33.091 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:33.091 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":11,"btime":"2024-08-31T12:16:31:307961+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:31.307955+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:33.091 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 11 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 msgr2=0x7f21a0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 0x7f21a0074600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009900 tx=0x7f21ac01b120 comp rx=0 tx=0).stop 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 msgr2=0x7f21c413dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c420 tx=0x7f21b400c8e0 comp rx=0 tx=0).stop 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 shutdown_connections 2024-08-31T12:16:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f21a00720f0 0x7f21a0074600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21c4153b90 0x7f21c4142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21c40c4760 0x7f21c413ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 --2- 172.21.15.164:0/2961886030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c40c3f70 0x7f21c413dd60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 >> 172.21.15.164:0/2961886030 conn(0x7f21c40717b0 msgr2=0x7f21c4140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 shutdown_connections 2024-08-31T12:16:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:33.090+0000 7f21ca600640 1 -- 172.21.15.164:0/2961886030 wait complete. 2024-08-31T12:16:33.115 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:16:31:307961+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 11, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 11, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4384": { "addr": "172.21.15.184:6837/1093030453", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 1093030453, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 1093030453, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4384, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:16:31.307955+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4384 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:16:34.723 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:16:34.727 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:16:35.116 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 -- 172.21.15.164:0/1537757550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 msgr2=0x7efe20152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 --2- 172.21.15.164:0/1537757550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20152a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe10009900 tx=0x7efe1001f0d0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 -- 172.21.15.164:0/1537757550 shutdown_connections 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 --2- 172.21.15.164:0/1537757550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c9330 0x7efe20074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 --2- 172.21.15.164:0/1537757550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20152a10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 -- 172.21.15.164:0/1537757550 >> 172.21.15.164:0/1537757550 conn(0x7efe200ccf20 msgr2=0x7efe200cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:35.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 -- 172.21.15.164:0/1537757550 shutdown_connections 2024-08-31T12:16:35.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.278+0000 7efe25e00640 1 -- 172.21.15.164:0/1537757550 wait complete. 2024-08-31T12:16:35.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 Processor -- start 2024-08-31T12:16:35.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- start start 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 0x7efe20156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe200c9330 0x7efe2014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efe200c8030 con 0x7efe2015bc70 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe200c3150 con 0x7efe200c9330 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efe20074c60 con 0x7efe200c1f40 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47096/0 (socket says 172.21.15.164:47096) 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 -- 172.21.15.164:0/2388117427 learned_addr learned my addr 172.21.15.164:0/2388117427 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1ea00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 0x7efe20156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:35.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe16000640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe200c9330 0x7efe2014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 -- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 msgr2=0x7efe20156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 0x7efe20156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 -- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe200c9330 msgr2=0x7efe2014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe200c9330 0x7efe2014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 -- 172.21.15.164:0/2388117427 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe20157270 con 0x7efe2015bc70 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1ea00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 0x7efe20156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe1f400640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe1800e970 tx=0x7efe1800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18004d30 con 0x7efe2015bc70 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe1800cb20 con 0x7efe2015bc70 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18005020 con 0x7efe2015bc70 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe20156570 con 0x7efe2015bc70 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.282+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe201f2fe0 con 0x7efe2015bc70 2024-08-31T12:16:35.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.286+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2015b6c0 con 0x7efe2015bc70 2024-08-31T12:16:35.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.286+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7efe180051c0 con 0x7efe2015bc70 2024-08-31T12:16:35.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.286+0000 7efe17e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 0x7efdfc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:35.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.286+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7efe180936f0 con 0x7efe2015bc70 2024-08-31T12:16:35.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.286+0000 7efe1ea00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 0x7efdfc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:35.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.290+0000 7efe1ea00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 0x7efdfc0745d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe100b2000 tx=0x7efe1001d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:35.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.290+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7efe18016030 con 0x7efe2015bc70 2024-08-31T12:16:35.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.490+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe201f5a20 con 0x7efe2015bc70 2024-08-31T12:16:35.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe17e00640 1 -- 172.21.15.164:0/2388117427 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6056 (secure 0 0 0) 0x7efe18067110 con 0x7efe2015bc70 2024-08-31T12:16:35.495 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:35.495 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":11,"btime":"2024-08-31T12:16:31:307961+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:31.307955+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:35.495 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 11 2024-08-31T12:16:35.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 msgr2=0x7efdfc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:35.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 0x7efdfc0745d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe100b2000 tx=0x7efe1001d910 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 msgr2=0x7efe20157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe1800e970 tx=0x7efe1800ee30 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 shutdown_connections 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7efdfc0720c0 0x7efdfc0745d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe2015bc70 0x7efe20157ae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe200c9330 0x7efe2014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 --2- 172.21.15.164:0/2388117427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe200c1f40 0x7efe20156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 >> 172.21.15.164:0/2388117427 conn(0x7efe200ccf20 msgr2=0x7efe200b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 shutdown_connections 2024-08-31T12:16:35.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:35.494+0000 7efe25e00640 1 -- 172.21.15.164:0/2388117427 wait complete. 2024-08-31T12:16:35.517 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:37.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:37.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 -- 172.21.15.164:0/4132900604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c1f40 msgr2=0x7f74080c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 --2- 172.21.15.164:0/4132900604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c1f40 0x7f74080c9330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7408073250 tx=0x7f73f401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 -- 172.21.15.164:0/4132900604 shutdown_connections 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 --2- 172.21.15.164:0/4132900604 >> v2:172.21.15.184:3300/0 conn(0x7f74080c7920 0x7f74080c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 --2- 172.21.15.164:0/4132900604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c1f40 0x7f74080c9330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 --2- 172.21.15.164:0/4132900604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 0x7f7408152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 -- 172.21.15.164:0/4132900604 >> 172.21.15.164:0/4132900604 conn(0x7f74080ccf20 msgr2=0x7f74080cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 -- 172.21.15.164:0/4132900604 shutdown_connections 2024-08-31T12:16:37.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.682+0000 7f740f400640 1 -- 172.21.15.164:0/4132900604 wait complete. 2024-08-31T12:16:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 Processor -- start 2024-08-31T12:16:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- start start 2024-08-31T12:16:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 0x7f74081e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 0x7f74080c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f74080748a0 con 0x7f74080c7920 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7408074720 con 0x7f74080c1f40 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f7408074a20 con 0x7f740815bc70 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37388/0 (socket says 172.21.15.164:37388) 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 -- 172.21.15.164:0/3045568973 learned_addr learned my addr 172.21.15.164:0/3045568973 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740ca00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 0x7f74081e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740d400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 0x7f74080c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 -- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 msgr2=0x7f74080c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 0x7f74080c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 -- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 msgr2=0x7f74081e1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 0x7f74081e1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 -- 172.21.15.164:0/3045568973 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74081f3210 con 0x7f74080c7920 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740ca00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 0x7f74081e1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7407e00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f73f401d760 tx=0x7f73f4005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40b5040 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73f4005320 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74081f2450 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40046d0 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74081f2a10 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.686+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7408074ea0 con 0x7f74080c7920 2024-08-31T12:16:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.690+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f73f40c1060 con 0x7f74080c7920 2024-08-31T12:16:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.690+0000 7f7404c00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 0x7f73e8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.690+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f73f412ff20 con 0x7f74080c7920 2024-08-31T12:16:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.690+0000 7f740ca00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 0x7f73e8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.690+0000 7f740ca00640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 0x7f73e8074600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73fc005fd0 tx=0x7f73fc005f00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.694+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f73f4018c10 con 0x7f74080c7920 2024-08-31T12:16:37.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.894+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74081f64f0 con 0x7f74080c7920 2024-08-31T12:16:37.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f7404c00640 1 -- 172.21.15.164:0/3045568973 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6060 (secure 0 0 0) 0x7f73f40fb370 con 0x7f74080c7920 2024-08-31T12:16:37.899 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:37.899 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":12,"btime":"2024-08-31T12:16:37:698863+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:37.066407+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":46,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:37.899 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 12 2024-08-31T12:16:37.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 msgr2=0x7f73e8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:37.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 0x7f73e8074600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73fc005fd0 tx=0x7f73fc005f00 comp rx=0 tx=0).stop 2024-08-31T12:16:37.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 msgr2=0x7f74080c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:37.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f73f401d760 tx=0x7f73f4005d60 comp rx=0 tx=0).stop 2024-08-31T12:16:37.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 shutdown_connections 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f73e80720f0 0x7f73e8074600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f740815bc70 0x7f74080c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74080c7920 0x7f74080c60e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 --2- 172.21.15.164:0/3045568973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74080c1f40 0x7f74081e1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 >> 172.21.15.164:0/3045568973 conn(0x7f74080ccf20 msgr2=0x7f74080b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 shutdown_connections 2024-08-31T12:16:37.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:37.898+0000 7f740f400640 1 -- 172.21.15.164:0/3045568973 wait complete. 2024-08-31T12:16:37.921 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:39.921 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- 172.21.15.164:0/1034339290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb74152a10 msgr2=0x7feb740c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 --2- 172.21.15.164:0/1034339290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb74152a10 0x7feb740c9330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009bc0 tx=0x7feb6c01f3b0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- 172.21.15.164:0/1034339290 shutdown_connections 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 --2- 172.21.15.164:0/1034339290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb74152a10 0x7feb740c9330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- 172.21.15.164:0/1034339290 >> 172.21.15.164:0/1034339290 conn(0x7feb740ccf20 msgr2=0x7feb740cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:40.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- 172.21.15.164:0/1034339290 shutdown_connections 2024-08-31T12:16:40.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- 172.21.15.164:0/1034339290 wait complete. 2024-08-31T12:16:40.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 Processor -- start 2024-08-31T12:16:40.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.086+0000 7feb7a000640 1 -- start start 2024-08-31T12:16:40.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb740c1f40 0x7feb740cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:40.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb74152a10 0x7feb74156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb74074e30 con 0x7feb7415bc70 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feb740c8030 con 0x7feb74152a10 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feb74074fb0 con 0x7feb740c1f40 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37400/0 (socket says 172.21.15.164:37400) 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 -- 172.21.15.164:0/2459624865 learned_addr learned my addr 172.21.15.164:0/2459624865 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73400640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb740c1f40 0x7feb740cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb6aa00640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb74152a10 0x7feb74156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 -- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb740c1f40 msgr2=0x7feb740cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:40.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb740c1f40 0x7feb740cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 -- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb74152a10 msgr2=0x7feb74156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:40.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb74152a10 0x7feb74156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 -- 172.21.15.164:0/2459624865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb74157460 con 0x7feb7415bc70 2024-08-31T12:16:40.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb73e00640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01bfc0 tx=0x7feb6c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0b4040 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb6c0bf070 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0afdf0 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb740c5480 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb74156440 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.090+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb740c9330 con 0x7feb7415bc70 2024-08-31T12:16:40.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.094+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7feb6c004000 con 0x7feb7415bc70 2024-08-31T12:16:40.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.094+0000 7feb6be00640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 0x7feb50074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:40.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.094+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7feb6c131130 con 0x7feb7415bc70 2024-08-31T12:16:40.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.094+0000 7feb73400640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 0x7feb50074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:40.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.094+0000 7feb73400640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 0x7feb50074600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb640046c0 tx=0x7feb64007ea0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:40.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.098+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feb6c018f10 con 0x7feb7415bc70 2024-08-31T12:16:40.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.294+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb740c82f0 con 0x7feb7415bc70 2024-08-31T12:16:40.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb6be00640 1 -- 172.21.15.164:0/2459624865 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6060 (secure 0 0 0) 0x7feb6c0fc050 con 0x7feb7415bc70 2024-08-31T12:16:40.299 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:40.299 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":12,"btime":"2024-08-31T12:16:37:698863+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:37.066407+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":46,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:40.299 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 12 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 msgr2=0x7feb50074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 0x7feb50074600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb640046c0 tx=0x7feb64007ea0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 msgr2=0x7feb740c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01bfc0 tx=0x7feb6c005b10 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 shutdown_connections 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb500720f0 0x7feb50074600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb7415bc70 0x7feb740c5f00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb74152a10 0x7feb74156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 --2- 172.21.15.164:0/2459624865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb740c1f40 0x7feb740cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 >> 172.21.15.164:0/2459624865 conn(0x7feb740ccf20 msgr2=0x7feb741e46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 shutdown_connections 2024-08-31T12:16:40.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:40.298+0000 7feb7a000640 1 -- 172.21.15.164:0/2459624865 wait complete. 2024-08-31T12:16:40.320 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:42.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:42.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 -- 172.21.15.164:0/581807960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 msgr2=0x7f64c41520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:42.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 --2- 172.21.15.164:0/581807960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c41520f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f64c40c81a0 tx=0x7f64b401c570 comp rx=0 tx=0).stop 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 -- 172.21.15.164:0/581807960 shutdown_connections 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 --2- 172.21.15.164:0/581807960 >> v2:172.21.15.184:3300/0 conn(0x7f64c40b2900 0x7f64c40c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 --2- 172.21.15.164:0/581807960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c41520f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 -- 172.21.15.164:0/581807960 >> 172.21.15.164:0/581807960 conn(0x7f64c40ccf20 msgr2=0x7f64c40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 -- 172.21.15.164:0/581807960 shutdown_connections 2024-08-31T12:16:42.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.474+0000 7f64cb200640 1 -- 172.21.15.164:0/581807960 wait complete. 2024-08-31T12:16:42.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 Processor -- start 2024-08-31T12:16:42.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- start start 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64c40b2900 0x7f64c41f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64c40c2480 0x7f64c41467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4158a10 con 0x7f64c40b2fe0 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40c9130 con 0x7f64c40c2480 2024-08-31T12:16:42.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f64c4162750 con 0x7f64c40b2900 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37430/0 (socket says 172.21.15.164:37430) 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 -- 172.21.15.164:0/1154923314 learned_addr learned my addr 172.21.15.164:0/1154923314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3e00640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64c40b2900 0x7f64c41f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c9200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64c40c2480 0x7f64c41467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 -- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64c40b2900 msgr2=0x7f64c41f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64c40b2900 0x7f64c41f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 -- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64c40c2480 msgr2=0x7f64c41467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64c40c2480 0x7f64c41467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 -- 172.21.15.164:0/1154923314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c41f9a40 con 0x7f64c40b2fe0 2024-08-31T12:16:42.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64c3400640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d950 tx=0x7f64b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0017070 con 0x7f64c40b2fe0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64b0009cc0 con 0x7f64c40b2fe0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c41f8d40 con 0x7f64c40b2fe0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00106c0 con 0x7f64c40b2fe0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.478+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c41f8fe0 con 0x7f64c40b2fe0 2024-08-31T12:16:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.482+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c40c1f40 con 0x7f64c40b2fe0 2024-08-31T12:16:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.482+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f64b001a070 con 0x7f64c40b2fe0 2024-08-31T12:16:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.482+0000 7f64bbe00640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 0x7f64a40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.482+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f64b0093190 con 0x7f64c40b2fe0 2024-08-31T12:16:42.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.482+0000 7f64c3e00640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 0x7f64a40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:42.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.486+0000 7f64c3e00640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 0x7f64a40745d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64b40af000 tx=0x7f64b401adb0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:42.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.486+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f64b005e670 con 0x7f64c40b2fe0 2024-08-31T12:16:42.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.690+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64c40c7280 con 0x7f64c40b2fe0 2024-08-31T12:16:42.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.690+0000 7f64bbe00640 1 -- 172.21.15.164:0/1154923314 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6060 (secure 0 0 0) 0x7f64b005df70 con 0x7f64c40b2fe0 2024-08-31T12:16:42.694 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:42.694 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":12,"btime":"2024-08-31T12:16:37:698863+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:37.066407+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":46,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:42.695 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 12 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 msgr2=0x7f64a40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 0x7f64a40745d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64b40af000 tx=0x7f64b401adb0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 msgr2=0x7f64c4149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d950 tx=0x7f64b000de10 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 shutdown_connections 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f64a40720c0 0x7f64a40745d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64c40c2480 0x7f64c41467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c40b2fe0 0x7f64c4149c50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 --2- 172.21.15.164:0/1154923314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64c40b2900 0x7f64c41f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 >> 172.21.15.164:0/1154923314 conn(0x7f64c40ccf20 msgr2=0x7f64c4156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 shutdown_connections 2024-08-31T12:16:42.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:42.694+0000 7f64cb200640 1 -- 172.21.15.164:0/1154923314 wait complete. 2024-08-31T12:16:42.717 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:44.718 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 -- 172.21.15.164:0/2001086319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb68003a10 msgr2=0x7fbb68003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 --2- 172.21.15.164:0/2001086319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb68003a10 0x7fbb68003e80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009ec0 tx=0x7fbb7401d680 comp rx=0 tx=0).stop 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb86600640 1 -- 172.21.15.164:0/2001086319 reap_dead start 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 -- 172.21.15.164:0/2001086319 shutdown_connections 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 -- 172.21.15.164:0/2001086319 >> 172.21.15.164:0/2001086319 conn(0x7fbb800ccf20 msgr2=0x7fbb800cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 -- 172.21.15.164:0/2001086319 shutdown_connections 2024-08-31T12:16:44.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.882+0000 7fbb88600640 1 -- 172.21.15.164:0/2001086319 wait complete. 2024-08-31T12:16:44.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 Processor -- start 2024-08-31T12:16:44.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 -- start start 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 0x7fbb80156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb8015ae20 0x7fbb8014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800c8030 con 0x7fbb8015aa10 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800c3150 con 0x7fbb68003a10 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb88600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb80152a10 con 0x7fbb8015ae20 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37444/0 (socket says 172.21.15.164:37444) 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 -- 172.21.15.164:0/2784980061 learned_addr learned my addr 172.21.15.164:0/2784980061 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85c00640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 0x7fbb80156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:44.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb86600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb8015ae20 0x7fbb8014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 -- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb8015ae20 msgr2=0x7fbb8014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb8015ae20 0x7fbb8014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 -- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 msgr2=0x7fbb80156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 0x7fbb80156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85200640 1 -- 172.21.15.164:0/2784980061 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80157060 con 0x7fbb8015aa10 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.886+0000 7fbb85c00640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 0x7fbb80156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb85200640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c012460 tx=0x7fbb6c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c013a40 con 0x7fbb8015aa10 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb6c017030 con 0x7fbb8015aa10 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c01d430 con 0x7fbb8015aa10 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb80156360 con 0x7fbb8015aa10 2024-08-31T12:16:44.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb801f30f0 con 0x7fbb8015aa10 2024-08-31T12:16:44.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb800c7920 con 0x7fbb8015aa10 2024-08-31T12:16:44.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.890+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbb6c01c3e0 con 0x7fbb8015aa10 2024-08-31T12:16:44.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.894+0000 7fbb7d600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 0x7fbb600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:44.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.894+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7fbb6c096b90 con 0x7fbb8015aa10 2024-08-31T12:16:44.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.894+0000 7fbb85c00640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 0x7fbb600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:44.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.894+0000 7fbb85c00640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 0x7fbb600745d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009ec0 tx=0x7fbb7401a420 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:44.898+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbb6c062100 con 0x7fbb8015aa10 2024-08-31T12:16:45.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.094+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb800b3250 con 0x7fbb8015aa10 2024-08-31T12:16:45.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.094+0000 7fbb7d600640 1 -- 172.21.15.164:0/2784980061 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6057 (secure 0 0 0) 0x7fbb6c061a00 con 0x7fbb8015aa10 2024-08-31T12:16:45.098 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:45.098 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":13,"btime":"2024-08-31T12:16:43:665876+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:42.801059+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":48,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 13 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 msgr2=0x7fbb600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 0x7fbb600745d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009ec0 tx=0x7fbb7401a420 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 msgr2=0x7fbb8014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c012460 tx=0x7fbb6c012920 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 shutdown_connections 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbb600720c0 0x7fbb600745d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb8015ae20 0x7fbb8014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb8015aa10 0x7fbb8014f330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 --2- 172.21.15.164:0/2784980061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb68003a10 0x7fbb80156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 >> 172.21.15.164:0/2784980061 conn(0x7fbb800ccf20 msgr2=0x7fbb80150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 shutdown_connections 2024-08-31T12:16:45.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:45.098+0000 7fbb88600640 1 -- 172.21.15.164:0/2784980061 wait complete. 2024-08-31T12:16:45.120 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:16:43:665876+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 13, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 13, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4384": { "addr": "172.21.15.184:6837/1093030453", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 1093030453, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 1093030453, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4384, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 48 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:16:42.801059+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4384 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:16:47.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:47.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 -- 172.21.15.164:0/785358400 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188005260 msgr2=0x7fe18800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/785358400 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188005260 0x7fe18800b9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40cadf0 tx=0x7fe19c01d5b0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 -- 172.21.15.164:0/785358400 shutdown_connections 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/785358400 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188005260 0x7fe18800b9d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 -- 172.21.15.164:0/785358400 >> 172.21.15.164:0/785358400 conn(0x7fe1a40ccf20 msgr2=0x7fe1a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 -- 172.21.15.164:0/785358400 shutdown_connections 2024-08-31T12:16:47.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.274+0000 7fe1a9a00640 1 -- 172.21.15.164:0/785358400 wait complete. 2024-08-31T12:16:47.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 Processor -- start 2024-08-31T12:16:47.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 -- start start 2024-08-31T12:16:47.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe188005260 0x7fe1a40c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:47.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a414f810 0x7fe1a414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40c9330 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40c26e0 con 0x7fe188005260 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe1a9a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a40c94b0 con 0x7fe1a414f810 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe19a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe19a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39746/0 (socket says 172.21.15.164:39746) 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.278+0000 7fe19a000640 1 -- 172.21.15.164:0/627282707 learned_addr learned my addr 172.21.15.164:0/627282707 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe1a3400640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a414f810 0x7fe1a414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 -- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a414f810 msgr2=0x7fe1a414fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a414f810 0x7fe1a414fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 -- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe188005260 msgr2=0x7fe1a40c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe188005260 0x7fe1a40c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 -- 172.21.15.164:0/627282707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a4150160 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19a000640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e590 tx=0x7fe18c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:47.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c015020 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c010980 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a41e2660 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c010dd0 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a40cbcf0 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a40cba50 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe18c018020 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.282+0000 7fe19b400640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 0x7fe180074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:47.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.286+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7fe18c0933c0 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.286+0000 7fe1a2a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 0x7fe180074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:47.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.286+0000 7fe1a2a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 0x7fe180074600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe194006c90 tx=0x7fe1940060b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:47.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.290+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe1a40cba50 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1a40c7920 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe19b400640 1 -- 172.21.15.164:0/627282707 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6057 (secure 0 0 0) 0x7fe18c01f020 con 0x7fe1a40cc8c0 2024-08-31T12:16:47.492 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:47.492 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":13,"btime":"2024-08-31T12:16:43:665876+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:42.801059+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":48,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:47.492 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 13 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 msgr2=0x7fe180074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 0x7fe180074600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe194006c90 tx=0x7fe1940060b0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 msgr2=0x7fe1a41e2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e590 tx=0x7fe18c00ea50 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 shutdown_connections 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1800720f0 0x7fe180074600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a414f810 0x7fe1a414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40cc8c0 0x7fe1a41e2120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 --2- 172.21.15.164:0/627282707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe188005260 0x7fe1a40c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 >> 172.21.15.164:0/627282707 conn(0x7fe1a40ccf20 msgr2=0x7fe1a4156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 shutdown_connections 2024-08-31T12:16:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:47.490+0000 7fe1a9a00640 1 -- 172.21.15.164:0/627282707 wait complete. 2024-08-31T12:16:47.514 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:49.515 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 -- 172.21.15.164:0/3845341565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b4159f60 msgr2=0x7fc8b415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 --2- 172.21.15.164:0/3845341565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b4159f60 0x7fc8b415a370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009840 tx=0x7fc8a001c820 comp rx=0 tx=0).stop 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 -- 172.21.15.164:0/3845341565 shutdown_connections 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 --2- 172.21.15.164:0/3845341565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b4159f60 0x7fc8b415a370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 -- 172.21.15.164:0/3845341565 >> 172.21.15.164:0/3845341565 conn(0x7fc8b4071be0 msgr2=0x7fc8b406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 -- 172.21.15.164:0/3845341565 shutdown_connections 2024-08-31T12:16:49.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.678+0000 7fc8ba600640 1 -- 172.21.15.164:0/3845341565 wait complete. 2024-08-31T12:16:49.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 Processor -- start 2024-08-31T12:16:49.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 -- start start 2024-08-31T12:16:49.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 0x7fc8b4151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:49.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:49.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b4159f60 0x7fc8b414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:49.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b41596f0 con 0x7fc8b40cedf0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40cf610 con 0x7fc8b4159f60 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8ba600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40c5160 con 0x7fc8b40c97e0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39764/0 (socket says 172.21.15.164:39764) 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 -- 172.21.15.164:0/1943391829 learned_addr learned my addr 172.21.15.164:0/1943391829 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b3e00640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b4159f60 0x7fc8b414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b3400640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 0x7fc8b4151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 -- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 msgr2=0x7fc8b4151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 0x7fc8b4151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 -- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b4159f60 msgr2=0x7fc8b414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b4159f60 0x7fc8b414b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b2a00640 1 -- 172.21.15.164:0/1943391829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b4150720 con 0x7fc8b40cedf0 2024-08-31T12:16:49.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.682+0000 7fc8b3400640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 0x7fc8b4151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8b2a00640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00b0040 tx=0x7fc8a0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00042f0 con 0x7fc8b40cedf0 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a00bd070 con 0x7fc8b40cedf0 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b406fd30 con 0x7fc8b40cedf0 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0005290 con 0x7fc8b40cedf0 2024-08-31T12:16:49.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b41509c0 con 0x7fc8b40cedf0 2024-08-31T12:16:49.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b4153610 con 0x7fc8b40cedf0 2024-08-31T12:16:49.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.686+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc8a0005430 con 0x7fc8b40cedf0 2024-08-31T12:16:49.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.690+0000 7fc8ab400640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 0x7fc8940745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:49.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.690+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7fc8a012d470 con 0x7fc8b40cedf0 2024-08-31T12:16:49.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.690+0000 7fc8b3400640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 0x7fc8940745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:49.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.690+0000 7fc8b3400640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 0x7fc8940745d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40046c0 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:49.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.694+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc8a00c6020 con 0x7fc8b40cedf0 2024-08-31T12:16:49.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.898+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8b40c5d30 con 0x7fc8b40cedf0 2024-08-31T12:16:49.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.898+0000 7fc8ab400640 1 -- 172.21.15.164:0/1943391829 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6063 (secure 0 0 0) 0x7fc8a0016410 con 0x7fc8b40cedf0 2024-08-31T12:16:49.901 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:49.901 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":14,"btime":"2024-08-31T12:16:49:695849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:48.781007+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:clientreplay","state_seq":50,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:49.902 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 14 2024-08-31T12:16:49.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 msgr2=0x7fc8940745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 0x7fc8940745d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40046c0 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 msgr2=0x7fc8b406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00b0040 tx=0x7fc8a0004040 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 shutdown_connections 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8940720c0 0x7fc8940745d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b4159f60 0x7fc8b414b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b40cedf0 0x7fc8b406ef60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 --2- 172.21.15.164:0/1943391829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b40c97e0 0x7fc8b4151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 >> 172.21.15.164:0/1943391829 conn(0x7fc8b4071be0 msgr2=0x7fc8b40cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 shutdown_connections 2024-08-31T12:16:49.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:49.902+0000 7fc8ba600640 1 -- 172.21.15.164:0/1943391829 wait complete. 2024-08-31T12:16:49.923 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:51.924 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:52.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- 172.21.15.164:0/3215834747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ef4004810 msgr2=0x7f3ef4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 --2- 172.21.15.164:0/3215834747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ef4004810 0x7f3ef4004c20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009b60 tx=0x7f3ef801d340 comp rx=0 tx=0).stop 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f0fe00640 1 -- 172.21.15.164:0/3215834747 reap_dead start 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- 172.21.15.164:0/3215834747 shutdown_connections 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- 172.21.15.164:0/3215834747 >> 172.21.15.164:0/3215834747 conn(0x7f3f100ccf20 msgr2=0x7f3f100cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- 172.21.15.164:0/3215834747 shutdown_connections 2024-08-31T12:16:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- 172.21.15.164:0/3215834747 wait complete. 2024-08-31T12:16:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 Processor -- start 2024-08-31T12:16:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.090+0000 7f3f16000640 1 -- start start 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef4004810 0x7f3f10158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f101f5030 0x7f3f100b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100c8030 con 0x7f3f10159a50 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100c3150 con 0x7f3ef4004810 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3f10074720 con 0x7f3f101f5030 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:52.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39776/0 (socket says 172.21.15.164:39776) 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 -- 172.21.15.164:0/3959274606 learned_addr learned my addr 172.21.15.164:0/3959274606 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0f400640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef4004810 0x7f3f10158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f07e00640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f101f5030 0x7f3f100b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 -- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f101f5030 msgr2=0x7f3f100b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f101f5030 0x7f3f100b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 -- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef4004810 msgr2=0x7f3f10158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef4004810 0x7f3f10158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 -- 172.21.15.164:0/3959274606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f100751f0 con 0x7f3f10159a50 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f0fe00640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f100735c0 tx=0x7f3f08010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08017070 con 0x7f3f10159a50 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f08015070 con 0x7f3f10159a50 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f10074e60 con 0x7f3f10159a50 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004d90 con 0x7f3f10159a50 2024-08-31T12:16:52.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1015aba0 con 0x7f3f10159a50 2024-08-31T12:16:52.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.094+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f10152a10 con 0x7f3f10159a50 2024-08-31T12:16:52.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.098+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3f08003980 con 0x7f3f10159a50 2024-08-31T12:16:52.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.098+0000 7f3f07400640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 0x7f3eec074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:52.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.098+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f3f08093470 con 0x7f3f10159a50 2024-08-31T12:16:52.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.098+0000 7f3f0f400640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 0x7f3eec074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:52.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.098+0000 7f3f0f400640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 0x7f3eec074600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f00001230 tx=0x7f3f00001120 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.102+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3f0805e950 con 0x7f3f10159a50 2024-08-31T12:16:52.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f101560a0 con 0x7f3f10159a50 2024-08-31T12:16:52.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f07400640 1 -- 172.21.15.164:0/3959274606 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6063 (secure 0 0 0) 0x7f3f0805e250 con 0x7f3f10159a50 2024-08-31T12:16:52.316 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:52.316 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":14,"btime":"2024-08-31T12:16:49:695849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:48.781007+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:clientreplay","state_seq":50,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:52.317 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 14 2024-08-31T12:16:52.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 msgr2=0x7f3eec074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:52.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 0x7f3eec074600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f00001230 tx=0x7f3f00001120 comp rx=0 tx=0).stop 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 msgr2=0x7f3f1014d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f100735c0 tx=0x7f3f08010e90 comp rx=0 tx=0).stop 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 shutdown_connections 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3eec0720f0 0x7f3eec074600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f10159a50 0x7f3f1014d860 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f101f5030 0x7f3f100b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 --2- 172.21.15.164:0/3959274606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef4004810 0x7f3f10158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:52.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 >> 172.21.15.164:0/3959274606 conn(0x7f3f100ccf20 msgr2=0x7f3f100b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:52.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 shutdown_connections 2024-08-31T12:16:52.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:52.314+0000 7f3f16000640 1 -- 172.21.15.164:0/3959274606 wait complete. 2024-08-31T12:16:52.338 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:54.339 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 -- 172.21.15.164:0/739222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3200004d50 msgr2=0x7f3200005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 --2- 172.21.15.164:0/739222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3200004d50 0x7f3200005160 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3210009e90 tx=0x7f321001d660 comp rx=0 tx=0).stop 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f321e400640 1 -- 172.21.15.164:0/739222512 reap_dead start 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 -- 172.21.15.164:0/739222512 shutdown_connections 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 -- 172.21.15.164:0/739222512 >> 172.21.15.164:0/739222512 conn(0x7f32180ccf20 msgr2=0x7f32180cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 -- 172.21.15.164:0/739222512 shutdown_connections 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.502+0000 7f3220400640 1 -- 172.21.15.164:0/739222512 wait complete. 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 Processor -- start 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 -- start start 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32181597f0 0x7f321814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3218150550 0x7f321815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f32180c8030 con 0x7f3218150140 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f32180c3150 con 0x7f3218150550 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3220400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3218074720 con 0x7f32181597f0 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39794/0 (socket says 172.21.15.164:39794) 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 -- 172.21.15.164:0/3349248903 learned_addr learned my addr 172.21.15.164:0/3349248903 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321da00640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32181597f0 0x7f321814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321e400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3218150550 0x7f321815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 -- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32181597f0 msgr2=0x7f321814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32181597f0 0x7f321814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 -- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3218150550 msgr2=0x7f321815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3218150550 0x7f321815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 -- 172.21.15.164:0/3349248903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32180cb940 con 0x7f3218150140 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f321d000640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3204011870 tx=0x7f3204011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320400fcd0 con 0x7f3218150140 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3204016070 con 0x7f3218150140 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.506+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204012690 con 0x7f3218150140 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32181556d0 con 0x7f3218150140 2024-08-31T12:16:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321815b2f0 con 0x7f3218150140 2024-08-31T12:16:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321814eea0 con 0x7f3218150140 2024-08-31T12:16:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3204018030 con 0x7f3218150140 2024-08-31T12:16:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3215600640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 0x7f31f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f3204093640 con 0x7f3218150140 2024-08-31T12:16:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.510+0000 7f321da00640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 0x7f31f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.514+0000 7f321da00640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 0x7f31f80745d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f320c001660 tx=0x7f320c0015f0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.514+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f320405e6a0 con 0x7f3218150140 2024-08-31T12:16:54.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.722+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3218152a10 con 0x7f3218150140 2024-08-31T12:16:54.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.722+0000 7f3215600640 1 -- 172.21.15.164:0/3349248903 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6063 (secure 0 0 0) 0x7f3204062e60 con 0x7f3218150140 2024-08-31T12:16:54.725 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":14,"btime":"2024-08-31T12:16:49:695849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:48.781007+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:clientreplay","state_seq":50,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:54.725 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 14 2024-08-31T12:16:54.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 msgr2=0x7f31f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:54.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 0x7f31f80745d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f320c001660 tx=0x7f320c0015f0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 msgr2=0x7f321815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:54.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3204011870 tx=0x7f3204011d30 comp rx=0 tx=0).stop 2024-08-31T12:16:54.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 shutdown_connections 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f31f80720c0 0x7f31f80745d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3218150550 0x7f321815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3218150140 0x7f321815a4d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 --2- 172.21.15.164:0/3349248903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32181597f0 0x7f321814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 >> 172.21.15.164:0/3349248903 conn(0x7f32180ccf20 msgr2=0x7f32180b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 shutdown_connections 2024-08-31T12:16:54.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:54.726+0000 7f3220400640 1 -- 172.21.15.164:0/3349248903 wait complete. 2024-08-31T12:16:54.750 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:16:56.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:56.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 -- 172.21.15.164:0/2101791164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 msgr2=0x7f35e00c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 --2- 172.21.15.164:0/2101791164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c97e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009840 tx=0x7f35cc01c6b0 comp rx=0 tx=0).stop 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 -- 172.21.15.164:0/2101791164 shutdown_connections 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 --2- 172.21.15.164:0/2101791164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c97e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 -- 172.21.15.164:0/2101791164 >> 172.21.15.164:0/2101791164 conn(0x7f35e0071be0 msgr2=0x7f35e006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 -- 172.21.15.164:0/2101791164 shutdown_connections 2024-08-31T12:16:56.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.962+0000 7f35e6600640 1 -- 172.21.15.164:0/2101791164 wait complete. 2024-08-31T12:16:56.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 Processor -- start 2024-08-31T12:16:56.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 -- start start 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e00cedf0 0x7f35e0149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e0155e80 0x7f35e01f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00cf610 con 0x7f35e00c5980 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00c5260 con 0x7f35e0155e80 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35e6600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f35e006e8f0 con 0x7f35e00cedf0 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35df400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35df400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40070/0 (socket says 172.21.15.164:40070) 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35df400640 1 -- 172.21.15.164:0/749977277 learned_addr learned my addr 172.21.15.164:0/749977277 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:56.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35dea00640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e00cedf0 0x7f35e0149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.966+0000 7f35dfe00640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e0155e80 0x7f35e01f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 -- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e00cedf0 msgr2=0x7f35e0149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e00cedf0 0x7f35e0149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 -- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e0155e80 msgr2=0x7f35e01f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e0155e80 0x7f35e01f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 -- 172.21.15.164:0/749977277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e00c8030 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35df400640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c400 tx=0x7f35d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0017070 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d0005400 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e014b250 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e01f92d0 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0003860 con 0x7f35e00c5980 2024-08-31T12:16:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.970+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b80052a0 con 0x7f35e00c5980 2024-08-31T12:16:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.974+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f35d001a070 con 0x7f35e00c5980 2024-08-31T12:16:56.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.974+0000 7f35d7400640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 0x7f35c00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:56.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.974+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7f35d0092120 con 0x7f35e00c5980 2024-08-31T12:16:56.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.974+0000 7f35dea00640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 0x7f35c00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.974+0000 7f35dea00640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 0x7f35c00745d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0af000 tx=0x7f35cc0b2040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:56.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:56.978+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f35d005d050 con 0x7f35e00c5980 2024-08-31T12:16:57.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35b8005860 con 0x7f35e00c5980 2024-08-31T12:16:57.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35d7400640 1 -- 172.21.15.164:0/749977277 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6063 (secure 0 0 0) 0x7f35d0061810 con 0x7f35e00c5980 2024-08-31T12:16:57.224 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:57.224 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":14,"btime":"2024-08-31T12:16:49:695849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:48.781007+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:clientreplay","state_seq":50,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:16:57.224 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 14 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 msgr2=0x7f35c00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 0x7f35c00745d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0af000 tx=0x7f35cc0b2040 comp rx=0 tx=0).stop 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 msgr2=0x7f35e00c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c400 tx=0x7f35d000c8c0 comp rx=0 tx=0).stop 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 shutdown_connections 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f35c00720c0 0x7f35c00745d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:57.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35e0155e80 0x7f35e01f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:57.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35e00cedf0 0x7f35e0149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:57.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 --2- 172.21.15.164:0/749977277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e00c5980 0x7f35e00c7af0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:57.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 >> 172.21.15.164:0/749977277 conn(0x7f35e0071be0 msgr2=0x7f35e00cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:57.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 shutdown_connections 2024-08-31T12:16:57.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:57.222+0000 7f35e6600640 1 -- 172.21.15.164:0/749977277 wait complete. 2024-08-31T12:16:57.252 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:16:49:695849+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 14, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4384": { "addr": "172.21.15.184:6837/1093030453", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 1093030453, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 1093030453, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4384, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:clientreplay", "state_seq": 50 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:16:48.781007+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4384 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:16:59.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:16:59.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- 172.21.15.164:0/1527584061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb5015bc70 msgr2=0x7feb50152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:59.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 --2- 172.21.15.164:0/1527584061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb5015bc70 0x7feb50152a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feb50073280 tx=0x7feb4001f370 comp rx=0 tx=0).stop 2024-08-31T12:16:59.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- 172.21.15.164:0/1527584061 shutdown_connections 2024-08-31T12:16:59.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 --2- 172.21.15.164:0/1527584061 >> v2:172.21.15.184:3300/0 conn(0x7feb500c9330 0x7feb50074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 --2- 172.21.15.164:0/1527584061 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb5015bc70 0x7feb50152a10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- 172.21.15.164:0/1527584061 >> 172.21.15.164:0/1527584061 conn(0x7feb500ccf20 msgr2=0x7feb500cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:59.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- 172.21.15.164:0/1527584061 shutdown_connections 2024-08-31T12:16:59.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- 172.21.15.164:0/1527584061 wait complete. 2024-08-31T12:16:59.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 Processor -- start 2024-08-31T12:16:59.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.418+0000 7feb55800640 1 -- start start 2024-08-31T12:16:59.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 0x7feb501f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:59.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:59.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 0x7feb50155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:59.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb500c8030 con 0x7feb500c9330 2024-08-31T12:16:59.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feb500c3150 con 0x7feb5015bc70 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feb50074c60 con 0x7feb500c1f40 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40078/0 (socket says 172.21.15.164:40078) 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 -- 172.21.15.164:0/60769743 learned_addr learned my addr 172.21.15.164:0/60769743 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb4f400640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 0x7feb50155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb4ea00640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 0x7feb501f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 -- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 msgr2=0x7feb501f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 0x7feb501f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 -- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 msgr2=0x7feb50155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 0x7feb50155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 -- 172.21.15.164:0/60769743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb501efbd0 con 0x7feb500c9330 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb4ea00640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 0x7feb501f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb4f400640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 0x7feb50155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:16:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb46000640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c3f0 tx=0x7feb3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38017070 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb38003600 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb50156690 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38003a50 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb50158860 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb50074720 con 0x7feb500c9330 2024-08-31T12:16:59.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.422+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7feb3801a070 con 0x7feb500c9330 2024-08-31T12:16:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.426+0000 7feb47400640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 0x7feb2c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:16:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.426+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7feb38092260 con 0x7feb500c9330 2024-08-31T12:16:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.426+0000 7feb4ea00640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 0x7feb2c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:16:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.426+0000 7feb4ea00640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 0x7feb2c0745d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb400b1000 tx=0x7feb4001dbb0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:16:59.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.430+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feb3805d740 con 0x7feb500c9330 2024-08-31T12:16:59.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb501560a0 con 0x7feb500c9330 2024-08-31T12:16:59.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb47400640 1 -- 172.21.15.164:0/60769743 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6064 (secure 0 0 0) 0x7feb3805d040 con 0x7feb500c9330 2024-08-31T12:16:59.631 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:16:59.632 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":15,"btime":"2024-08-31T12:16:57:679716+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:16:59.632 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 15 2024-08-31T12:16:59.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 msgr2=0x7feb2c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:59.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 0x7feb2c0745d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb400b1000 tx=0x7feb4001dbb0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 msgr2=0x7feb500c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c3f0 tx=0x7feb3800c8b0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 shutdown_connections 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7feb2c0720c0 0x7feb2c0745d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb5015bc70 0x7feb50155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb500c9330 0x7feb500c4d00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 --2- 172.21.15.164:0/60769743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb500c1f40 0x7feb501f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 >> 172.21.15.164:0/60769743 conn(0x7feb500ccf20 msgr2=0x7feb5014fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 shutdown_connections 2024-08-31T12:16:59.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:16:59.630+0000 7feb55800640 1 -- 172.21.15.164:0/60769743 wait complete. 2024-08-31T12:16:59.654 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4393 2024-08-31T12:16:59.654 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 6 secs before reviving mds.a 2024-08-31T12:17:03.197 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/30 file after the snapshot 2024-08-31T12:17:03.233 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/31 file after the snapshot 2024-08-31T12:17:03.235 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/32 file after the snapshot 2024-08-31T12:17:03.239 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/33 file after the snapshot 2024-08-31T12:17:03.242 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/34 file after the snapshot 2024-08-31T12:17:03.245 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/35 file after the snapshot 2024-08-31T12:17:03.248 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/36 file after the snapshot 2024-08-31T12:17:03.251 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/37 file after the snapshot 2024-08-31T12:17:03.254 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/38 file after the snapshot 2024-08-31T12:17:03.257 INFO:tasks.workunit.client.0.smithi164.stdout: create 251/39 file after the snapshot 2024-08-31T12:17:03.261 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/.snap/snap-subdir-test 2024-08-31T12:17:03.913 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/30 file after the snapshot 2024-08-31T12:17:03.916 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/31 file after the snapshot 2024-08-31T12:17:03.918 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/32 file after the snapshot 2024-08-31T12:17:03.925 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/33 file after the snapshot 2024-08-31T12:17:03.925 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/34 file after the snapshot 2024-08-31T12:17:03.926 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/35 file after the snapshot 2024-08-31T12:17:03.929 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/36 file after the snapshot 2024-08-31T12:17:03.931 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/37 file after the snapshot 2024-08-31T12:17:03.934 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/38 file after the snapshot 2024-08-31T12:17:03.937 INFO:tasks.workunit.client.0.smithi164.stdout: create 252/39 file after the snapshot 2024-08-31T12:17:03.940 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/.snap/snap-subdir-test 2024-08-31T12:17:03.972 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/30 file after the snapshot 2024-08-31T12:17:03.974 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/31 file after the snapshot 2024-08-31T12:17:03.976 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/32 file after the snapshot 2024-08-31T12:17:03.979 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/33 file after the snapshot 2024-08-31T12:17:03.981 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/34 file after the snapshot 2024-08-31T12:17:03.984 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/35 file after the snapshot 2024-08-31T12:17:03.986 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/36 file after the snapshot 2024-08-31T12:17:03.988 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/37 file after the snapshot 2024-08-31T12:17:03.991 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/38 file after the snapshot 2024-08-31T12:17:03.993 INFO:tasks.workunit.client.0.smithi164.stdout: create 253/39 file after the snapshot 2024-08-31T12:17:03.995 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/.snap/snap-subdir-test 2024-08-31T12:17:04.023 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/30 file after the snapshot 2024-08-31T12:17:04.026 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/31 file after the snapshot 2024-08-31T12:17:04.029 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/32 file after the snapshot 2024-08-31T12:17:04.032 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/33 file after the snapshot 2024-08-31T12:17:04.034 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/34 file after the snapshot 2024-08-31T12:17:04.037 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/35 file after the snapshot 2024-08-31T12:17:04.040 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/36 file after the snapshot 2024-08-31T12:17:04.042 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/37 file after the snapshot 2024-08-31T12:17:04.044 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/38 file after the snapshot 2024-08-31T12:17:04.047 INFO:tasks.workunit.client.0.smithi164.stdout: create 254/39 file after the snapshot 2024-08-31T12:17:04.049 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/.snap/snap-subdir-test 2024-08-31T12:17:04.079 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/30 file after the snapshot 2024-08-31T12:17:04.081 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/31 file after the snapshot 2024-08-31T12:17:04.084 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/32 file after the snapshot 2024-08-31T12:17:04.086 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/33 file after the snapshot 2024-08-31T12:17:04.088 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/34 file after the snapshot 2024-08-31T12:17:04.091 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/35 file after the snapshot 2024-08-31T12:17:04.093 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/36 file after the snapshot 2024-08-31T12:17:04.096 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/37 file after the snapshot 2024-08-31T12:17:04.098 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/38 file after the snapshot 2024-08-31T12:17:04.101 INFO:tasks.workunit.client.0.smithi164.stdout: create 255/39 file after the snapshot 2024-08-31T12:17:04.103 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/.snap/snap-subdir-test 2024-08-31T12:17:04.134 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/30 file after the snapshot 2024-08-31T12:17:04.137 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/31 file after the snapshot 2024-08-31T12:17:04.139 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/32 file after the snapshot 2024-08-31T12:17:04.142 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/33 file after the snapshot 2024-08-31T12:17:04.145 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/34 file after the snapshot 2024-08-31T12:17:04.147 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/35 file after the snapshot 2024-08-31T12:17:04.150 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/36 file after the snapshot 2024-08-31T12:17:04.152 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/37 file after the snapshot 2024-08-31T12:17:04.155 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/38 file after the snapshot 2024-08-31T12:17:04.158 INFO:tasks.workunit.client.0.smithi164.stdout: create 256/39 file after the snapshot 2024-08-31T12:17:04.160 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/.snap/snap-subdir-test 2024-08-31T12:17:04.191 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/30 file after the snapshot 2024-08-31T12:17:04.194 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/31 file after the snapshot 2024-08-31T12:17:04.196 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/32 file after the snapshot 2024-08-31T12:17:04.199 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/33 file after the snapshot 2024-08-31T12:17:04.201 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/34 file after the snapshot 2024-08-31T12:17:04.204 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/35 file after the snapshot 2024-08-31T12:17:04.206 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/36 file after the snapshot 2024-08-31T12:17:04.209 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/37 file after the snapshot 2024-08-31T12:17:04.212 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/38 file after the snapshot 2024-08-31T12:17:04.214 INFO:tasks.workunit.client.0.smithi164.stdout: create 257/39 file after the snapshot 2024-08-31T12:17:04.217 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/.snap/snap-subdir-test 2024-08-31T12:17:04.248 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/30 file after the snapshot 2024-08-31T12:17:04.251 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/31 file after the snapshot 2024-08-31T12:17:04.254 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/32 file after the snapshot 2024-08-31T12:17:04.257 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/33 file after the snapshot 2024-08-31T12:17:04.259 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/34 file after the snapshot 2024-08-31T12:17:04.262 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/35 file after the snapshot 2024-08-31T12:17:04.264 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/36 file after the snapshot 2024-08-31T12:17:04.267 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/37 file after the snapshot 2024-08-31T12:17:04.269 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/38 file after the snapshot 2024-08-31T12:17:04.272 INFO:tasks.workunit.client.0.smithi164.stdout: create 258/39 file after the snapshot 2024-08-31T12:17:04.275 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/.snap/snap-subdir-test 2024-08-31T12:17:04.304 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/30 file after the snapshot 2024-08-31T12:17:04.307 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/31 file after the snapshot 2024-08-31T12:17:04.309 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/32 file after the snapshot 2024-08-31T12:17:04.312 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/33 file after the snapshot 2024-08-31T12:17:04.314 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/34 file after the snapshot 2024-08-31T12:17:04.317 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/35 file after the snapshot 2024-08-31T12:17:04.320 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/36 file after the snapshot 2024-08-31T12:17:04.322 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/37 file after the snapshot 2024-08-31T12:17:04.325 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/38 file after the snapshot 2024-08-31T12:17:04.327 INFO:tasks.workunit.client.0.smithi164.stdout: create 259/39 file after the snapshot 2024-08-31T12:17:04.332 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/.snap/snap-subdir-test 2024-08-31T12:17:04.361 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/30 file after the snapshot 2024-08-31T12:17:04.364 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/31 file after the snapshot 2024-08-31T12:17:04.367 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/32 file after the snapshot 2024-08-31T12:17:04.369 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/33 file after the snapshot 2024-08-31T12:17:04.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/34 file after the snapshot 2024-08-31T12:17:04.374 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/35 file after the snapshot 2024-08-31T12:17:04.377 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/36 file after the snapshot 2024-08-31T12:17:04.379 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/37 file after the snapshot 2024-08-31T12:17:04.382 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/38 file after the snapshot 2024-08-31T12:17:04.385 INFO:tasks.workunit.client.0.smithi164.stdout: create 260/39 file after the snapshot 2024-08-31T12:17:04.387 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/.snap/snap-subdir-test 2024-08-31T12:17:04.419 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/30 file after the snapshot 2024-08-31T12:17:04.421 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/31 file after the snapshot 2024-08-31T12:17:04.423 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/32 file after the snapshot 2024-08-31T12:17:04.426 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/33 file after the snapshot 2024-08-31T12:17:04.429 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/34 file after the snapshot 2024-08-31T12:17:04.431 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/35 file after the snapshot 2024-08-31T12:17:04.434 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/36 file after the snapshot 2024-08-31T12:17:04.436 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/37 file after the snapshot 2024-08-31T12:17:04.439 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/38 file after the snapshot 2024-08-31T12:17:04.441 INFO:tasks.workunit.client.0.smithi164.stdout: create 261/39 file after the snapshot 2024-08-31T12:17:04.444 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/.snap/snap-subdir-test 2024-08-31T12:17:04.475 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/30 file after the snapshot 2024-08-31T12:17:04.478 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/31 file after the snapshot 2024-08-31T12:17:04.480 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/32 file after the snapshot 2024-08-31T12:17:04.483 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/33 file after the snapshot 2024-08-31T12:17:04.485 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/34 file after the snapshot 2024-08-31T12:17:04.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/35 file after the snapshot 2024-08-31T12:17:04.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/36 file after the snapshot 2024-08-31T12:17:04.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/37 file after the snapshot 2024-08-31T12:17:04.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/38 file after the snapshot 2024-08-31T12:17:04.498 INFO:tasks.workunit.client.0.smithi164.stdout: create 262/39 file after the snapshot 2024-08-31T12:17:04.501 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/.snap/snap-subdir-test 2024-08-31T12:17:04.530 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/30 file after the snapshot 2024-08-31T12:17:04.533 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/31 file after the snapshot 2024-08-31T12:17:04.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/32 file after the snapshot 2024-08-31T12:17:04.537 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/33 file after the snapshot 2024-08-31T12:17:04.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/34 file after the snapshot 2024-08-31T12:17:04.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/35 file after the snapshot 2024-08-31T12:17:04.544 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/36 file after the snapshot 2024-08-31T12:17:04.547 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/37 file after the snapshot 2024-08-31T12:17:04.549 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/38 file after the snapshot 2024-08-31T12:17:04.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 263/39 file after the snapshot 2024-08-31T12:17:04.554 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/.snap/snap-subdir-test 2024-08-31T12:17:04.585 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/30 file after the snapshot 2024-08-31T12:17:04.587 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/31 file after the snapshot 2024-08-31T12:17:04.590 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/32 file after the snapshot 2024-08-31T12:17:04.593 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/33 file after the snapshot 2024-08-31T12:17:04.595 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/34 file after the snapshot 2024-08-31T12:17:04.597 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/35 file after the snapshot 2024-08-31T12:17:04.600 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/36 file after the snapshot 2024-08-31T12:17:04.603 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/37 file after the snapshot 2024-08-31T12:17:04.605 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/38 file after the snapshot 2024-08-31T12:17:04.608 INFO:tasks.workunit.client.0.smithi164.stdout: create 264/39 file after the snapshot 2024-08-31T12:17:04.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/.snap/snap-subdir-test 2024-08-31T12:17:04.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/30 file after the snapshot 2024-08-31T12:17:04.643 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/31 file after the snapshot 2024-08-31T12:17:04.646 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/32 file after the snapshot 2024-08-31T12:17:04.648 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/33 file after the snapshot 2024-08-31T12:17:04.651 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/34 file after the snapshot 2024-08-31T12:17:04.653 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/35 file after the snapshot 2024-08-31T12:17:04.656 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/36 file after the snapshot 2024-08-31T12:17:04.659 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/37 file after the snapshot 2024-08-31T12:17:04.661 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/38 file after the snapshot 2024-08-31T12:17:04.664 INFO:tasks.workunit.client.0.smithi164.stdout: create 265/39 file after the snapshot 2024-08-31T12:17:04.667 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/.snap/snap-subdir-test 2024-08-31T12:17:04.696 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/30 file after the snapshot 2024-08-31T12:17:04.698 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/31 file after the snapshot 2024-08-31T12:17:04.701 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/32 file after the snapshot 2024-08-31T12:17:04.703 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/33 file after the snapshot 2024-08-31T12:17:04.705 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/34 file after the snapshot 2024-08-31T12:17:04.707 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/35 file after the snapshot 2024-08-31T12:17:04.710 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/36 file after the snapshot 2024-08-31T12:17:04.712 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/37 file after the snapshot 2024-08-31T12:17:04.715 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/38 file after the snapshot 2024-08-31T12:17:04.717 INFO:tasks.workunit.client.0.smithi164.stdout: create 266/39 file after the snapshot 2024-08-31T12:17:04.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:17:04.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:17:05.509 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/.snap/snap-subdir-test 2024-08-31T12:17:05.655 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-08-31T12:17:05.655 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-31T12:17:05.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-31T12:17:05.659 INFO:tasks.ceph.mds.a:Started 2024-08-31T12:17:05.659 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:17:05.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/30 file after the snapshot 2024-08-31T12:17:05.690 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/31 file after the snapshot 2024-08-31T12:17:05.693 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/32 file after the snapshot 2024-08-31T12:17:05.695 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/33 file after the snapshot 2024-08-31T12:17:05.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/34 file after the snapshot 2024-08-31T12:17:05.701 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/35 file after the snapshot 2024-08-31T12:17:05.704 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/36 file after the snapshot 2024-08-31T12:17:05.707 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/37 file after the snapshot 2024-08-31T12:17:05.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/38 file after the snapshot 2024-08-31T12:17:05.712 INFO:tasks.workunit.client.0.smithi164.stdout: create 267/39 file after the snapshot 2024-08-31T12:17:05.715 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/.snap/snap-subdir-test 2024-08-31T12:17:05.746 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/30 file after the snapshot 2024-08-31T12:17:05.751 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/31 file after the snapshot 2024-08-31T12:17:05.755 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/32 file after the snapshot 2024-08-31T12:17:05.759 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/33 file after the snapshot 2024-08-31T12:17:05.763 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/34 file after the snapshot 2024-08-31T12:17:05.767 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/35 file after the snapshot 2024-08-31T12:17:05.771 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/36 file after the snapshot 2024-08-31T12:17:05.771 INFO:tasks.ceph.mds.a.smithi164.stdout:starting mds.a at 2024-08-31T12:17:05.775 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/37 file after the snapshot 2024-08-31T12:17:05.778 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/38 file after the snapshot 2024-08-31T12:17:05.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 268/39 file after the snapshot 2024-08-31T12:17:05.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/.snap/snap-subdir-test 2024-08-31T12:17:05.816 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/30 file after the snapshot 2024-08-31T12:17:05.819 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/31 file after the snapshot 2024-08-31T12:17:05.821 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/32 file after the snapshot 2024-08-31T12:17:05.824 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/33 file after the snapshot 2024-08-31T12:17:05.826 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/34 file after the snapshot 2024-08-31T12:17:05.829 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/35 file after the snapshot 2024-08-31T12:17:05.831 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/36 file after the snapshot 2024-08-31T12:17:05.834 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/37 file after the snapshot 2024-08-31T12:17:05.837 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/38 file after the snapshot 2024-08-31T12:17:05.841 INFO:tasks.workunit.client.0.smithi164.stdout: create 269/39 file after the snapshot 2024-08-31T12:17:05.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- 172.21.15.164:0/3642614745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf28005260 msgr2=0x7fdf2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:17:05.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 --2- 172.21.15.164:0/3642614745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf28005260 0x7fdf2800b9d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c660 tx=0x7fdf3801d2e0 comp rx=0 tx=0).stop 2024-08-31T12:17:05.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- 172.21.15.164:0/3642614745 shutdown_connections 2024-08-31T12:17:05.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 --2- 172.21.15.164:0/3642614745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf28005260 0x7fdf2800b9d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:05.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- 172.21.15.164:0/3642614745 >> 172.21.15.164:0/3642614745 conn(0x7fdf40071f20 msgr2=0x7fdf40072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:17:05.844 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/.snap/snap-subdir-test 2024-08-31T12:17:05.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- 172.21.15.164:0/3642614745 shutdown_connections 2024-08-31T12:17:05.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- 172.21.15.164:0/3642614745 wait complete. 2024-08-31T12:17:05.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 Processor -- start 2024-08-31T12:17:05.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.842+0000 7fdf46a00640 1 -- start start 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf28005260 0x7fdf401f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf401581c0 0x7fdf40146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400c7690 con 0x7fdf4014b060 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400c8d60 con 0x7fdf401581c0 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdf40070df0 con 0x7fdf28005260 2024-08-31T12:17:05.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47402/0 (socket says 172.21.15.164:47402) 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 -- 172.21.15.164:0/552496860 learned_addr learned my addr 172.21.15.164:0/552496860 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf45600640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf28005260 0x7fdf401f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46000640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf401581c0 0x7fdf40146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 -- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf28005260 msgr2=0x7fdf401f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf28005260 0x7fdf401f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 -- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf401581c0 msgr2=0x7fdf40146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf401581c0 0x7fdf40146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 -- 172.21.15.164:0/552496860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401f5a10 con 0x7fdf4014b060 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf44c00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c004cf0 tx=0x7fdf2c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:17:05.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c015020 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf2c011750 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf40158b80 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c011b80 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf40147bd0 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.846+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf40147660 con 0x7fdf4014b060 2024-08-31T12:17:05.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.850+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdf2c018020 con 0x7fdf4014b060 2024-08-31T12:17:05.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.850+0000 7fdf3d600640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 0x7fdf200745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:17:05.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.850+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6676+0+0 (secure 0 0 0) 0x7fdf2c093680 con 0x7fdf4014b060 2024-08-31T12:17:05.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.850+0000 7fdf45600640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 0x7fdf200745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:17:05.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.850+0000 7fdf45600640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 0x7fdf200745d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf34005e10 tx=0x7fdf340091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:17:05.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:05.854+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdf2c01f030 con 0x7fdf4014b060 2024-08-31T12:17:06.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.054+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf40152840 con 0x7fdf4014b060 2024-08-31T12:17:06.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.054+0000 7fdf3d600640 1 -- 172.21.15.164:0/552496860 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7fdf401f5a10 con 0x7fdf4014b060 2024-08-31T12:17:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:17:06.059 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:17:06.061 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:17:06.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 msgr2=0x7fdf200745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 0x7fdf200745d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf34005e10 tx=0x7fdf340091e0 comp rx=0 tx=0).stop 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 msgr2=0x7fdf4014bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c004cf0 tx=0x7fdf2c001640 comp rx=0 tx=0).stop 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 shutdown_connections 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf200720c0 0x7fdf200745d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:06.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf401581c0 0x7fdf40146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:06.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf4014b060 0x7fdf4014bd40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:06.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 --2- 172.21.15.164:0/552496860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf28005260 0x7fdf401f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:17:06.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 >> 172.21.15.164:0/552496860 conn(0x7fdf40071f20 msgr2=0x7fdf4006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:17:06.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 shutdown_connections 2024-08-31T12:17:06.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:17:06.058+0000 7fdf46a00640 1 -- 172.21.15.164:0/552496860 wait complete. 2024-08-31T12:17:06.080 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-08-31T12:17:06.081 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 116 secs before thrashing 2024-08-31T12:17:06.470 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/30 file after the snapshot 2024-08-31T12:17:06.472 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/31 file after the snapshot 2024-08-31T12:17:06.475 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/32 file after the snapshot 2024-08-31T12:17:06.478 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/33 file after the snapshot 2024-08-31T12:17:06.481 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/34 file after the snapshot 2024-08-31T12:17:06.483 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/35 file after the snapshot 2024-08-31T12:17:06.486 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/36 file after the snapshot 2024-08-31T12:17:06.488 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/37 file after the snapshot 2024-08-31T12:17:06.491 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/38 file after the snapshot 2024-08-31T12:17:06.493 INFO:tasks.workunit.client.0.smithi164.stdout: create 270/39 file after the snapshot 2024-08-31T12:17:06.496 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/.snap/snap-subdir-test 2024-08-31T12:17:06.528 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/30 file after the snapshot 2024-08-31T12:17:06.530 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/31 file after the snapshot 2024-08-31T12:17:06.533 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/32 file after the snapshot 2024-08-31T12:17:06.536 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/33 file after the snapshot 2024-08-31T12:17:06.538 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/34 file after the snapshot 2024-08-31T12:17:06.541 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/35 file after the snapshot 2024-08-31T12:17:06.543 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/36 file after the snapshot 2024-08-31T12:17:06.546 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/37 file after the snapshot 2024-08-31T12:17:06.549 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/38 file after the snapshot 2024-08-31T12:17:06.551 INFO:tasks.workunit.client.0.smithi164.stdout: create 271/39 file after the snapshot 2024-08-31T12:17:06.554 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/.snap/snap-subdir-test 2024-08-31T12:17:06.584 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/30 file after the snapshot 2024-08-31T12:17:06.586 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/31 file after the snapshot 2024-08-31T12:17:06.589 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/32 file after the snapshot 2024-08-31T12:17:06.591 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/33 file after the snapshot 2024-08-31T12:17:06.594 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/34 file after the snapshot 2024-08-31T12:17:06.596 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/35 file after the snapshot 2024-08-31T12:17:06.599 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/36 file after the snapshot 2024-08-31T12:17:06.601 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/37 file after the snapshot 2024-08-31T12:17:06.604 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/38 file after the snapshot 2024-08-31T12:17:06.606 INFO:tasks.workunit.client.0.smithi164.stdout: create 272/39 file after the snapshot 2024-08-31T12:17:06.609 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/.snap/snap-subdir-test 2024-08-31T12:17:06.639 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/30 file after the snapshot 2024-08-31T12:17:06.641 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/31 file after the snapshot 2024-08-31T12:17:06.644 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/32 file after the snapshot 2024-08-31T12:17:06.647 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/33 file after the snapshot 2024-08-31T12:17:06.649 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/34 file after the snapshot 2024-08-31T12:17:06.651 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/35 file after the snapshot 2024-08-31T12:17:06.654 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/36 file after the snapshot 2024-08-31T12:17:06.656 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/37 file after the snapshot 2024-08-31T12:17:06.658 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/38 file after the snapshot 2024-08-31T12:17:06.661 INFO:tasks.workunit.client.0.smithi164.stdout: create 273/39 file after the snapshot 2024-08-31T12:17:06.663 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/.snap/snap-subdir-test 2024-08-31T12:17:06.697 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/30 file after the snapshot 2024-08-31T12:17:06.699 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/31 file after the snapshot 2024-08-31T12:17:06.700 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/32 file after the snapshot 2024-08-31T12:17:06.702 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/33 file after the snapshot 2024-08-31T12:17:06.703 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/34 file after the snapshot 2024-08-31T12:17:06.705 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/35 file after the snapshot 2024-08-31T12:17:06.707 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/36 file after the snapshot 2024-08-31T12:17:06.709 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/37 file after the snapshot 2024-08-31T12:17:06.711 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/38 file after the snapshot 2024-08-31T12:17:06.713 INFO:tasks.workunit.client.0.smithi164.stdout: create 274/39 file after the snapshot 2024-08-31T12:17:06.714 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/.snap/snap-subdir-test 2024-08-31T12:17:06.743 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/30 file after the snapshot 2024-08-31T12:17:06.745 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/31 file after the snapshot 2024-08-31T12:17:06.747 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/32 file after the snapshot 2024-08-31T12:17:06.748 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/33 file after the snapshot 2024-08-31T12:17:06.750 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/34 file after the snapshot 2024-08-31T12:17:06.751 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/35 file after the snapshot 2024-08-31T12:17:06.752 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/36 file after the snapshot 2024-08-31T12:17:06.754 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/37 file after the snapshot 2024-08-31T12:17:06.756 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/38 file after the snapshot 2024-08-31T12:17:06.757 INFO:tasks.workunit.client.0.smithi164.stdout: create 275/39 file after the snapshot 2024-08-31T12:17:06.759 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/.snap/snap-subdir-test 2024-08-31T12:17:06.788 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/30 file after the snapshot 2024-08-31T12:17:06.791 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/31 file after the snapshot 2024-08-31T12:17:06.793 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/32 file after the snapshot 2024-08-31T12:17:06.795 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/33 file after the snapshot 2024-08-31T12:17:06.798 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/34 file after the snapshot 2024-08-31T12:17:06.800 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/35 file after the snapshot 2024-08-31T12:17:06.802 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/36 file after the snapshot 2024-08-31T12:17:06.805 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/37 file after the snapshot 2024-08-31T12:17:06.807 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/38 file after the snapshot 2024-08-31T12:17:06.810 INFO:tasks.workunit.client.0.smithi164.stdout: create 276/39 file after the snapshot 2024-08-31T12:17:06.812 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/.snap/snap-subdir-test 2024-08-31T12:17:06.844 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/30 file after the snapshot 2024-08-31T12:17:06.846 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/31 file after the snapshot 2024-08-31T12:17:06.848 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/32 file after the snapshot 2024-08-31T12:17:06.851 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/33 file after the snapshot 2024-08-31T12:17:06.853 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/34 file after the snapshot 2024-08-31T12:17:06.856 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/35 file after the snapshot 2024-08-31T12:17:06.858 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/36 file after the snapshot 2024-08-31T12:17:06.861 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/37 file after the snapshot 2024-08-31T12:17:06.863 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/38 file after the snapshot 2024-08-31T12:17:06.866 INFO:tasks.workunit.client.0.smithi164.stdout: create 277/39 file after the snapshot 2024-08-31T12:17:06.868 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/.snap/snap-subdir-test 2024-08-31T12:17:06.901 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/30 file after the snapshot 2024-08-31T12:17:06.903 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/31 file after the snapshot 2024-08-31T12:17:06.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/32 file after the snapshot 2024-08-31T12:17:06.907 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/33 file after the snapshot 2024-08-31T12:17:06.909 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/34 file after the snapshot 2024-08-31T12:17:06.911 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/35 file after the snapshot 2024-08-31T12:17:06.913 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/36 file after the snapshot 2024-08-31T12:17:06.915 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/37 file after the snapshot 2024-08-31T12:17:06.917 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/38 file after the snapshot 2024-08-31T12:17:06.919 INFO:tasks.workunit.client.0.smithi164.stdout: create 278/39 file after the snapshot 2024-08-31T12:17:06.921 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/.snap/snap-subdir-test 2024-08-31T12:17:06.952 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/30 file after the snapshot 2024-08-31T12:17:06.954 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/31 file after the snapshot 2024-08-31T12:17:06.957 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/32 file after the snapshot 2024-08-31T12:17:06.959 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/33 file after the snapshot 2024-08-31T12:17:06.962 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/34 file after the snapshot 2024-08-31T12:17:06.965 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/35 file after the snapshot 2024-08-31T12:17:06.967 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/36 file after the snapshot 2024-08-31T12:17:06.970 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/37 file after the snapshot 2024-08-31T12:17:06.972 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/38 file after the snapshot 2024-08-31T12:17:06.975 INFO:tasks.workunit.client.0.smithi164.stdout: create 279/39 file after the snapshot 2024-08-31T12:17:06.978 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/.snap/snap-subdir-test 2024-08-31T12:17:07.010 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/30 file after the snapshot 2024-08-31T12:17:07.012 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/31 file after the snapshot 2024-08-31T12:17:07.015 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/32 file after the snapshot 2024-08-31T12:17:07.018 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/33 file after the snapshot 2024-08-31T12:17:07.020 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/34 file after the snapshot 2024-08-31T12:17:07.023 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/35 file after the snapshot 2024-08-31T12:17:07.026 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/36 file after the snapshot 2024-08-31T12:17:07.028 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/37 file after the snapshot 2024-08-31T12:17:07.031 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/38 file after the snapshot 2024-08-31T12:17:07.034 INFO:tasks.workunit.client.0.smithi164.stdout: create 280/39 file after the snapshot 2024-08-31T12:17:07.036 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/.snap/snap-subdir-test 2024-08-31T12:17:07.053 INFO:tasks.ceph.mds.d.smithi184.stderr:2024-08-31T12:17:07.051+0000 7f73495bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:17:07.068 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/30 file after the snapshot 2024-08-31T12:17:07.070 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/31 file after the snapshot 2024-08-31T12:17:07.073 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/32 file after the snapshot 2024-08-31T12:17:07.075 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/33 file after the snapshot 2024-08-31T12:17:07.078 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/34 file after the snapshot 2024-08-31T12:17:07.080 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/35 file after the snapshot 2024-08-31T12:17:07.083 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/36 file after the snapshot 2024-08-31T12:17:07.086 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/37 file after the snapshot 2024-08-31T12:17:07.088 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/38 file after the snapshot 2024-08-31T12:17:07.340 INFO:tasks.workunit.client.0.smithi164.stdout: create 281/39 file after the snapshot 2024-08-31T12:17:07.342 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/.snap/snap-subdir-test 2024-08-31T12:17:07.372 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/30 file after the snapshot 2024-08-31T12:17:07.374 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/31 file after the snapshot 2024-08-31T12:17:07.377 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/32 file after the snapshot 2024-08-31T12:17:07.380 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/33 file after the snapshot 2024-08-31T12:17:07.383 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/34 file after the snapshot 2024-08-31T12:17:07.385 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/35 file after the snapshot 2024-08-31T12:17:07.388 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/36 file after the snapshot 2024-08-31T12:17:07.391 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/37 file after the snapshot 2024-08-31T12:17:07.393 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/38 file after the snapshot 2024-08-31T12:17:07.396 INFO:tasks.workunit.client.0.smithi164.stdout: create 282/39 file after the snapshot 2024-08-31T12:17:07.398 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/.snap/snap-subdir-test 2024-08-31T12:17:07.427 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/30 file after the snapshot 2024-08-31T12:17:07.430 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/31 file after the snapshot 2024-08-31T12:17:07.432 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/32 file after the snapshot 2024-08-31T12:17:07.435 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/33 file after the snapshot 2024-08-31T12:17:07.437 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/34 file after the snapshot 2024-08-31T12:17:07.440 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/35 file after the snapshot 2024-08-31T12:17:07.442 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/36 file after the snapshot 2024-08-31T12:17:07.445 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/37 file after the snapshot 2024-08-31T12:17:07.448 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/38 file after the snapshot 2024-08-31T12:17:07.450 INFO:tasks.workunit.client.0.smithi164.stdout: create 283/39 file after the snapshot 2024-08-31T12:17:07.453 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/.snap/snap-subdir-test 2024-08-31T12:17:07.482 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/30 file after the snapshot 2024-08-31T12:17:07.484 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/31 file after the snapshot 2024-08-31T12:17:07.487 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/32 file after the snapshot 2024-08-31T12:17:07.489 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/33 file after the snapshot 2024-08-31T12:17:07.492 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/34 file after the snapshot 2024-08-31T12:17:07.495 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/35 file after the snapshot 2024-08-31T12:17:07.497 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/36 file after the snapshot 2024-08-31T12:17:07.499 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/37 file after the snapshot 2024-08-31T12:17:07.502 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/38 file after the snapshot 2024-08-31T12:17:07.504 INFO:tasks.workunit.client.0.smithi164.stdout: create 284/39 file after the snapshot 2024-08-31T12:17:07.506 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/.snap/snap-subdir-test 2024-08-31T12:17:07.535 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/30 file after the snapshot 2024-08-31T12:17:07.537 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/31 file after the snapshot 2024-08-31T12:17:07.540 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/32 file after the snapshot 2024-08-31T12:17:07.542 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/33 file after the snapshot 2024-08-31T12:17:07.545 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/34 file after the snapshot 2024-08-31T12:17:07.548 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/35 file after the snapshot 2024-08-31T12:17:07.550 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/36 file after the snapshot 2024-08-31T12:17:07.553 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/37 file after the snapshot 2024-08-31T12:17:07.556 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/38 file after the snapshot 2024-08-31T12:17:07.558 INFO:tasks.workunit.client.0.smithi164.stdout: create 285/39 file after the snapshot 2024-08-31T12:17:07.560 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/.snap/snap-subdir-test 2024-08-31T12:17:07.600 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/30 file after the snapshot 2024-08-31T12:17:07.602 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/31 file after the snapshot 2024-08-31T12:17:07.605 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/32 file after the snapshot 2024-08-31T12:17:07.607 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/33 file after the snapshot 2024-08-31T12:17:07.610 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/34 file after the snapshot 2024-08-31T12:17:07.613 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/35 file after the snapshot 2024-08-31T12:17:07.616 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/36 file after the snapshot 2024-08-31T12:17:07.617 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/37 file after the snapshot 2024-08-31T12:17:07.620 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/38 file after the snapshot 2024-08-31T12:17:07.622 INFO:tasks.workunit.client.0.smithi164.stdout: create 286/39 file after the snapshot 2024-08-31T12:17:07.624 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/.snap/snap-subdir-test 2024-08-31T12:17:07.664 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/30 file after the snapshot 2024-08-31T12:17:07.667 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/31 file after the snapshot 2024-08-31T12:17:07.669 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/32 file after the snapshot 2024-08-31T12:17:07.672 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/33 file after the snapshot 2024-08-31T12:17:07.674 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/34 file after the snapshot 2024-08-31T12:17:07.676 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/35 file after the snapshot 2024-08-31T12:17:07.679 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/36 file after the snapshot 2024-08-31T12:17:07.681 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/37 file after the snapshot 2024-08-31T12:17:07.684 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/38 file after the snapshot 2024-08-31T12:17:07.686 INFO:tasks.workunit.client.0.smithi164.stdout: create 287/39 file after the snapshot 2024-08-31T12:17:07.688 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/.snap/snap-subdir-test 2024-08-31T12:17:07.729 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/30 file after the snapshot 2024-08-31T12:17:07.731 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/31 file after the snapshot 2024-08-31T12:17:07.734 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/32 file after the snapshot 2024-08-31T12:17:07.737 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/33 file after the snapshot 2024-08-31T12:17:07.739 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/34 file after the snapshot 2024-08-31T12:17:07.742 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/35 file after the snapshot 2024-08-31T12:17:07.745 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/36 file after the snapshot 2024-08-31T12:17:07.747 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/37 file after the snapshot 2024-08-31T12:17:07.749 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/38 file after the snapshot 2024-08-31T12:17:07.752 INFO:tasks.workunit.client.0.smithi164.stdout: create 288/39 file after the snapshot 2024-08-31T12:17:07.755 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/.snap/snap-subdir-test 2024-08-31T12:17:07.782 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/30 file after the snapshot 2024-08-31T12:17:07.785 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/31 file after the snapshot 2024-08-31T12:17:07.787 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/32 file after the snapshot 2024-08-31T12:17:07.790 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/33 file after the snapshot 2024-08-31T12:17:07.795 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/34 file after the snapshot 2024-08-31T12:17:07.797 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/35 file after the snapshot 2024-08-31T12:17:07.799 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/36 file after the snapshot 2024-08-31T12:17:07.801 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/37 file after the snapshot 2024-08-31T12:17:07.803 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/38 file after the snapshot 2024-08-31T12:17:07.805 INFO:tasks.workunit.client.0.smithi164.stdout: create 289/39 file after the snapshot 2024-08-31T12:17:07.807 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/.snap/snap-subdir-test 2024-08-31T12:17:07.832 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/30 file after the snapshot 2024-08-31T12:17:07.835 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/31 file after the snapshot 2024-08-31T12:17:07.838 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/32 file after the snapshot 2024-08-31T12:17:07.840 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/33 file after the snapshot 2024-08-31T12:17:07.843 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/34 file after the snapshot 2024-08-31T12:17:07.845 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/35 file after the snapshot 2024-08-31T12:17:07.848 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/36 file after the snapshot 2024-08-31T12:17:07.850 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/37 file after the snapshot 2024-08-31T12:17:07.853 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/38 file after the snapshot 2024-08-31T12:17:07.856 INFO:tasks.workunit.client.0.smithi164.stdout: create 290/39 file after the snapshot 2024-08-31T12:17:07.858 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/.snap/snap-subdir-test 2024-08-31T12:17:07.886 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/30 file after the snapshot 2024-08-31T12:17:07.889 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/31 file after the snapshot 2024-08-31T12:17:07.891 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/32 file after the snapshot 2024-08-31T12:17:07.894 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/33 file after the snapshot 2024-08-31T12:17:07.897 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/34 file after the snapshot 2024-08-31T12:17:07.899 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/35 file after the snapshot 2024-08-31T12:17:07.902 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/36 file after the snapshot 2024-08-31T12:17:07.905 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/37 file after the snapshot 2024-08-31T12:17:07.907 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/38 file after the snapshot 2024-08-31T12:17:07.909 INFO:tasks.workunit.client.0.smithi164.stdout: create 291/39 file after the snapshot 2024-08-31T12:17:07.912 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/.snap/snap-subdir-test 2024-08-31T12:17:07.941 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/30 file after the snapshot 2024-08-31T12:17:07.943 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/31 file after the snapshot 2024-08-31T12:17:07.945 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/32 file after the snapshot 2024-08-31T12:17:07.948 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/33 file after the snapshot 2024-08-31T12:17:07.950 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/34 file after the snapshot 2024-08-31T12:17:07.953 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/35 file after the snapshot 2024-08-31T12:17:07.955 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/36 file after the snapshot 2024-08-31T12:17:07.958 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/37 file after the snapshot 2024-08-31T12:17:07.960 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/38 file after the snapshot 2024-08-31T12:17:07.963 INFO:tasks.workunit.client.0.smithi164.stdout: create 292/39 file after the snapshot 2024-08-31T12:17:07.965 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/.snap/snap-subdir-test 2024-08-31T12:17:07.993 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/30 file after the snapshot 2024-08-31T12:17:07.996 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/31 file after the snapshot 2024-08-31T12:17:07.998 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/32 file after the snapshot 2024-08-31T12:17:08.001 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/33 file after the snapshot 2024-08-31T12:17:08.004 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/34 file after the snapshot 2024-08-31T12:17:08.006 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/35 file after the snapshot 2024-08-31T12:17:08.009 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/36 file after the snapshot 2024-08-31T12:17:08.011 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/37 file after the snapshot 2024-08-31T12:17:08.014 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/38 file after the snapshot 2024-08-31T12:17:08.017 INFO:tasks.workunit.client.0.smithi164.stdout: create 293/39 file after the snapshot 2024-08-31T12:17:08.020 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/.snap/snap-subdir-test 2024-08-31T12:17:08.049 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/30 file after the snapshot 2024-08-31T12:17:08.051 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/31 file after the snapshot 2024-08-31T12:17:08.054 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/32 file after the snapshot 2024-08-31T12:17:08.056 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/33 file after the snapshot 2024-08-31T12:17:08.059 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/34 file after the snapshot 2024-08-31T12:17:08.062 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/35 file after the snapshot 2024-08-31T12:17:08.065 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/36 file after the snapshot 2024-08-31T12:17:08.067 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/37 file after the snapshot 2024-08-31T12:17:08.070 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/38 file after the snapshot 2024-08-31T12:17:08.072 INFO:tasks.workunit.client.0.smithi164.stdout: create 294/39 file after the snapshot 2024-08-31T12:17:08.075 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/.snap/snap-subdir-test 2024-08-31T12:17:08.104 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/30 file after the snapshot 2024-08-31T12:17:08.107 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/31 file after the snapshot 2024-08-31T12:17:08.110 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/32 file after the snapshot 2024-08-31T12:17:08.112 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/33 file after the snapshot 2024-08-31T12:17:08.115 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/34 file after the snapshot 2024-08-31T12:17:08.117 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/35 file after the snapshot 2024-08-31T12:17:08.120 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/36 file after the snapshot 2024-08-31T12:17:08.122 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/37 file after the snapshot 2024-08-31T12:17:08.125 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/38 file after the snapshot 2024-08-31T12:17:08.128 INFO:tasks.workunit.client.0.smithi164.stdout: create 295/39 file after the snapshot 2024-08-31T12:17:08.130 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/.snap/snap-subdir-test 2024-08-31T12:17:08.170 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/30 file after the snapshot 2024-08-31T12:17:08.172 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/31 file after the snapshot 2024-08-31T12:17:08.175 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/32 file after the snapshot 2024-08-31T12:17:08.178 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/33 file after the snapshot 2024-08-31T12:17:08.180 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/34 file after the snapshot 2024-08-31T12:17:08.183 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/35 file after the snapshot 2024-08-31T12:17:08.185 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/36 file after the snapshot 2024-08-31T12:17:08.188 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/37 file after the snapshot 2024-08-31T12:17:08.190 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/38 file after the snapshot 2024-08-31T12:17:08.193 INFO:tasks.workunit.client.0.smithi164.stdout: create 296/39 file after the snapshot 2024-08-31T12:17:08.195 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/.snap/snap-subdir-test 2024-08-31T12:17:08.225 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/30 file after the snapshot 2024-08-31T12:17:08.227 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/31 file after the snapshot 2024-08-31T12:17:08.230 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/32 file after the snapshot 2024-08-31T12:17:08.233 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/33 file after the snapshot 2024-08-31T12:17:08.235 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/34 file after the snapshot 2024-08-31T12:17:08.238 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/35 file after the snapshot 2024-08-31T12:17:08.240 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/36 file after the snapshot 2024-08-31T12:17:08.242 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/37 file after the snapshot 2024-08-31T12:17:08.245 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/38 file after the snapshot 2024-08-31T12:17:08.247 INFO:tasks.workunit.client.0.smithi164.stdout: create 297/39 file after the snapshot 2024-08-31T12:17:08.250 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/.snap/snap-subdir-test 2024-08-31T12:17:08.280 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/30 file after the snapshot 2024-08-31T12:17:08.283 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/31 file after the snapshot 2024-08-31T12:17:08.285 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/32 file after the snapshot 2024-08-31T12:17:08.288 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/33 file after the snapshot 2024-08-31T12:17:08.290 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/34 file after the snapshot 2024-08-31T12:17:08.293 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/35 file after the snapshot 2024-08-31T12:17:08.296 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/36 file after the snapshot 2024-08-31T12:17:08.298 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/37 file after the snapshot 2024-08-31T12:17:08.300 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/38 file after the snapshot 2024-08-31T12:17:08.303 INFO:tasks.workunit.client.0.smithi164.stdout: create 298/39 file after the snapshot 2024-08-31T12:17:08.305 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/.snap/snap-subdir-test 2024-08-31T12:17:08.333 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/30 file after the snapshot 2024-08-31T12:17:08.336 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/31 file after the snapshot 2024-08-31T12:17:08.338 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/32 file after the snapshot 2024-08-31T12:17:08.341 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/33 file after the snapshot 2024-08-31T12:17:08.343 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/34 file after the snapshot 2024-08-31T12:17:08.346 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/35 file after the snapshot 2024-08-31T12:17:08.348 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/36 file after the snapshot 2024-08-31T12:17:08.351 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/37 file after the snapshot 2024-08-31T12:17:08.353 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/38 file after the snapshot 2024-08-31T12:17:08.356 INFO:tasks.workunit.client.0.smithi164.stdout: create 299/39 file after the snapshot 2024-08-31T12:17:08.359 INFO:tasks.workunit.client.0.smithi164.stdout:Take second snapshot .snap/test2 2024-08-31T12:17:08.385 INFO:tasks.workunit.client.0.smithi164.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-08-31T12:17:10.648 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-08-31T12:17:10.649 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-08-31T12:17:10.650 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-08-31T12:17:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-08-31T12:17:10.652 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-08-31T12:17:10.653 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-08-31T12:17:10.654 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-08-31T12:17:10.654 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-08-31T12:17:10.654 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-08-31T12:17:11.019 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-08-31T12:17:11.020 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-08-31T12:17:11.021 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-08-31T12:17:11.022 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-08-31T12:17:11.023 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-08-31T12:17:11.024 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-08-31T12:17:11.025 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-08-31T12:17:11.025 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-08-31T12:17:11.025 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-08-31T12:17:11.025 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-08-31T12:17:13.411 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-08-31T12:17:13.411 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-08-31T12:17:13.412 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-08-31T12:17:13.413 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-08-31T12:17:13.414 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-08-31T12:17:13.415 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-08-31T12:17:13.416 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-08-31T12:17:13.417 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-08-31T12:17:13.418 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-08-31T12:17:13.418 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-08-31T12:17:13.418 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-08-31T12:17:14.009 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-08-31T12:17:14.010 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-08-31T12:17:14.011 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-08-31T12:17:14.012 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-08-31T12:17:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-08-31T12:17:14.014 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-08-31T12:17:15.217 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-08-31T12:17:15.217 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-08-31T12:17:15.218 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-08-31T12:17:15.219 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-08-31T12:17:15.220 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-08-31T12:17:15.221 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-08-31T12:17:15.222 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-08-31T12:17:15.223 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-08-31T12:17:15.224 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-08-31T12:17:15.224 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-08-31T12:17:15.602 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-08-31T12:17:15.603 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-08-31T12:17:15.604 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-08-31T12:17:15.605 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-08-31T12:17:15.606 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-08-31T12:17:15.607 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-08-31T12:17:15.608 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-08-31T12:17:17.266 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-08-31T12:17:17.266 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-08-31T12:17:17.267 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-08-31T12:17:17.268 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-08-31T12:17:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-08-31T12:17:17.270 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-08-31T12:17:17.271 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-08-31T12:17:17.272 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-08-31T12:17:18.672 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-08-31T12:17:18.672 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-08-31T12:17:18.673 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-08-31T12:17:18.674 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-08-31T12:17:18.675 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-08-31T12:17:18.676 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-08-31T12:17:18.677 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-08-31T12:17:18.678 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-08-31T12:17:18.679 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-08-31T12:17:20.377 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-08-31T12:17:20.378 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-08-31T12:17:20.379 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-08-31T12:17:20.380 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-08-31T12:17:20.381 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-08-31T12:17:20.382 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-08-31T12:17:20.383 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-08-31T12:17:20.793 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-08-31T12:17:20.793 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-08-31T12:17:20.793 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-08-31T12:17:20.794 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-08-31T12:17:20.795 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-08-31T12:17:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-08-31T12:17:20.797 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-08-31T12:17:20.798 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-08-31T12:17:20.799 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-08-31T12:17:22.165 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-08-31T12:17:22.165 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-08-31T12:17:22.165 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-08-31T12:17:22.165 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-08-31T12:17:22.166 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-08-31T12:17:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-08-31T12:17:22.168 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-08-31T12:17:22.169 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-08-31T12:17:22.170 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-08-31T12:17:22.171 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-08-31T12:17:22.830 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-08-31T12:17:22.831 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-08-31T12:17:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-08-31T12:17:22.833 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-08-31T12:17:22.834 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-08-31T12:17:22.835 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-08-31T12:17:22.836 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-08-31T12:17:22.837 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-08-31T12:17:22.838 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-08-31T12:17:23.774 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-08-31T12:17:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-08-31T12:17:23.776 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-08-31T12:17:23.777 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-08-31T12:17:23.778 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-08-31T12:17:23.779 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-08-31T12:17:23.780 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-08-31T12:17:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-08-31T12:17:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-08-31T12:17:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-08-31T12:17:24.437 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-08-31T12:17:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-08-31T12:17:24.439 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-08-31T12:17:24.735 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-08-31T12:17:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-08-31T12:17:24.737 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-08-31T12:17:24.738 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-08-31T12:17:24.739 INFO:tasks.workunit.client.0.smithi164.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-08-31T12:17:24.740 INFO:tasks.workunit.client.0.smithi164.stdout:Take third snapshot .snap/test3 2024-08-31T12:17:25.453 INFO:tasks.workunit.client.0.smithi164.stdout:Delete the snapshots... 2024-08-31T12:17:26.708 INFO:tasks.workunit.client.0.smithi164.stdout:.//.snap/test1 2024-08-31T12:17:26.708 INFO:tasks.workunit.client.0.smithi164.stdout:.//.snap/test2 2024-08-31T12:17:26.708 INFO:tasks.workunit.client.0.smithi164.stdout:.//.snap/test3 2024-08-31T12:17:26.717 INFO:tasks.workunit.client.0.smithi164.stdout:./274/.snap/snap-subdir-test 2024-08-31T12:17:26.730 INFO:tasks.workunit.client.0.smithi164.stdout:./166/.snap/snap-subdir-test 2024-08-31T12:17:26.739 INFO:tasks.workunit.client.0.smithi164.stdout:./256/.snap/snap-subdir-test 2024-08-31T12:17:26.751 INFO:tasks.workunit.client.0.smithi164.stdout:./247/.snap/snap-subdir-test 2024-08-31T12:17:26.763 INFO:tasks.workunit.client.0.smithi164.stdout:./248/.snap/snap-subdir-test 2024-08-31T12:17:26.775 INFO:tasks.workunit.client.0.smithi164.stdout:./147/.snap/snap-subdir-test 2024-08-31T12:17:26.786 INFO:tasks.workunit.client.0.smithi164.stdout:./151/.snap/snap-subdir-test 2024-08-31T12:17:26.799 INFO:tasks.workunit.client.0.smithi164.stdout:./170/.snap/snap-subdir-test 2024-08-31T12:17:26.811 INFO:tasks.workunit.client.0.smithi164.stdout:./167/.snap/snap-subdir-test 2024-08-31T12:17:26.821 INFO:tasks.workunit.client.0.smithi164.stdout:./140/.snap/snap-subdir-test 2024-08-31T12:17:26.833 INFO:tasks.workunit.client.0.smithi164.stdout:./142/.snap/snap-subdir-test 2024-08-31T12:17:26.848 INFO:tasks.workunit.client.0.smithi164.stdout:./150/.snap/snap-subdir-test 2024-08-31T12:17:26.860 INFO:tasks.workunit.client.0.smithi164.stdout:./273/.snap/snap-subdir-test 2024-08-31T12:17:26.871 INFO:tasks.workunit.client.0.smithi164.stdout:./269/.snap/snap-subdir-test 2024-08-31T12:17:26.886 INFO:tasks.workunit.client.0.smithi164.stdout:./105/.snap/snap-subdir-test 2024-08-31T12:17:26.901 INFO:tasks.workunit.client.0.smithi164.stdout:./210/.snap/snap-subdir-test 2024-08-31T12:17:26.910 INFO:tasks.workunit.client.0.smithi164.stdout:./265/.snap/snap-subdir-test 2024-08-31T12:17:26.924 INFO:tasks.workunit.client.0.smithi164.stdout:./218/.snap/snap-subdir-test 2024-08-31T12:17:26.936 INFO:tasks.workunit.client.0.smithi164.stdout:./290/.snap/snap-subdir-test 2024-08-31T12:17:26.952 INFO:tasks.workunit.client.0.smithi164.stdout:./149/.snap/snap-subdir-test 2024-08-31T12:17:26.968 INFO:tasks.workunit.client.0.smithi164.stdout:./109/.snap/snap-subdir-test 2024-08-31T12:17:26.979 INFO:tasks.workunit.client.0.smithi164.stdout:./292/.snap/snap-subdir-test 2024-08-31T12:17:26.991 INFO:tasks.workunit.client.0.smithi164.stdout:./242/.snap/snap-subdir-test 2024-08-31T12:17:27.004 INFO:tasks.workunit.client.0.smithi164.stdout:./158/.snap/snap-subdir-test 2024-08-31T12:17:27.016 INFO:tasks.workunit.client.0.smithi164.stdout:./243/.snap/snap-subdir-test 2024-08-31T12:17:27.029 INFO:tasks.workunit.client.0.smithi164.stdout:./106/.snap/snap-subdir-test 2024-08-31T12:17:27.042 INFO:tasks.workunit.client.0.smithi164.stdout:./250/.snap/snap-subdir-test 2024-08-31T12:17:27.054 INFO:tasks.workunit.client.0.smithi164.stdout:./221/.snap/snap-subdir-test 2024-08-31T12:17:27.066 INFO:tasks.workunit.client.0.smithi164.stdout:./244/.snap/snap-subdir-test 2024-08-31T12:17:27.076 INFO:tasks.workunit.client.0.smithi164.stdout:./258/.snap/snap-subdir-test 2024-08-31T12:17:27.085 INFO:tasks.workunit.client.0.smithi164.stdout:./268/.snap/snap-subdir-test 2024-08-31T12:17:27.097 INFO:tasks.workunit.client.0.smithi164.stdout:./189/.snap/snap-subdir-test 2024-08-31T12:17:27.106 INFO:tasks.workunit.client.0.smithi164.stdout:./285/.snap/snap-subdir-test 2024-08-31T12:17:27.117 INFO:tasks.workunit.client.0.smithi164.stdout:./208/.snap/snap-subdir-test 2024-08-31T12:17:27.126 INFO:tasks.workunit.client.0.smithi164.stdout:./288/.snap/snap-subdir-test 2024-08-31T12:17:27.139 INFO:tasks.workunit.client.0.smithi164.stdout:./209/.snap/snap-subdir-test 2024-08-31T12:17:27.148 INFO:tasks.workunit.client.0.smithi164.stdout:./253/.snap/snap-subdir-test 2024-08-31T12:17:27.160 INFO:tasks.workunit.client.0.smithi164.stdout:./249/.snap/snap-subdir-test 2024-08-31T12:17:27.172 INFO:tasks.workunit.client.0.smithi164.stdout:./133/.snap/snap-subdir-test 2024-08-31T12:17:27.434 INFO:tasks.workunit.client.0.smithi164.stdout:./291/.snap/snap-subdir-test 2024-08-31T12:17:27.447 INFO:tasks.workunit.client.0.smithi164.stdout:./226/.snap/snap-subdir-test 2024-08-31T12:17:27.460 INFO:tasks.workunit.client.0.smithi164.stdout:./173/.snap/snap-subdir-test 2024-08-31T12:17:27.473 INFO:tasks.workunit.client.0.smithi164.stdout:./174/.snap/snap-subdir-test 2024-08-31T12:17:27.483 INFO:tasks.workunit.client.0.smithi164.stdout:./299/.snap/snap-subdir-test 2024-08-31T12:17:27.744 INFO:tasks.workunit.client.0.smithi164.stdout:./262/.snap/snap-subdir-test 2024-08-31T12:17:27.757 INFO:tasks.workunit.client.0.smithi164.stdout:./231/.snap/snap-subdir-test 2024-08-31T12:17:27.771 INFO:tasks.workunit.client.0.smithi164.stdout:./214/.snap/snap-subdir-test 2024-08-31T12:17:27.781 INFO:tasks.workunit.client.0.smithi164.stdout:./281/.snap/snap-subdir-test 2024-08-31T12:17:27.796 INFO:tasks.workunit.client.0.smithi164.stdout:./289/.snap/snap-subdir-test 2024-08-31T12:17:27.810 INFO:tasks.workunit.client.0.smithi164.stdout:./283/.snap/snap-subdir-test 2024-08-31T12:17:27.823 INFO:tasks.workunit.client.0.smithi164.stdout:./232/.snap/snap-subdir-test 2024-08-31T12:17:27.832 INFO:tasks.workunit.client.0.smithi164.stdout:./298/.snap/snap-subdir-test 2024-08-31T12:17:27.844 INFO:tasks.workunit.client.0.smithi164.stdout:./233/.snap/snap-subdir-test 2024-08-31T12:17:27.855 INFO:tasks.workunit.client.0.smithi164.stdout:./155/.snap/snap-subdir-test 2024-08-31T12:17:28.118 INFO:tasks.workunit.client.0.smithi164.stdout:./114/.snap/snap-subdir-test 2024-08-31T12:17:28.131 INFO:tasks.workunit.client.0.smithi164.stdout:./159/.snap/snap-subdir-test 2024-08-31T12:17:28.515 INFO:tasks.workunit.client.0.smithi164.stdout:./187/.snap/snap-subdir-test 2024-08-31T12:17:29.964 INFO:tasks.workunit.client.0.smithi164.stdout:./185/.snap/snap-subdir-test 2024-08-31T12:17:29.975 INFO:tasks.workunit.client.0.smithi164.stdout:./293/.snap/snap-subdir-test 2024-08-31T12:17:29.989 INFO:tasks.workunit.client.0.smithi164.stdout:./228/.snap/snap-subdir-test 2024-08-31T12:17:30.002 INFO:tasks.workunit.client.0.smithi164.stdout:./120/.snap/snap-subdir-test 2024-08-31T12:17:30.016 INFO:tasks.workunit.client.0.smithi164.stdout:./110/.snap/snap-subdir-test 2024-08-31T12:17:30.026 INFO:tasks.workunit.client.0.smithi164.stdout:./267/.snap/snap-subdir-test 2024-08-31T12:17:30.038 INFO:tasks.workunit.client.0.smithi164.stdout:./202/.snap/snap-subdir-test 2024-08-31T12:17:30.051 INFO:tasks.workunit.client.0.smithi164.stdout:./137/.snap/snap-subdir-test 2024-08-31T12:17:30.064 INFO:tasks.workunit.client.0.smithi164.stdout:./246/.snap/snap-subdir-test 2024-08-31T12:17:30.077 INFO:tasks.workunit.client.0.smithi164.stdout:./219/.snap/snap-subdir-test 2024-08-31T12:17:30.090 INFO:tasks.workunit.client.0.smithi164.stdout:./198/.snap/snap-subdir-test 2024-08-31T12:17:30.502 INFO:tasks.workunit.client.0.smithi164.stdout:./136/.snap/snap-subdir-test 2024-08-31T12:17:30.512 INFO:tasks.workunit.client.0.smithi164.stdout:./270/.snap/snap-subdir-test 2024-08-31T12:17:30.524 INFO:tasks.workunit.client.0.smithi164.stdout:./125/.snap/snap-subdir-test 2024-08-31T12:17:30.536 INFO:tasks.workunit.client.0.smithi164.stdout:./194/.snap/snap-subdir-test 2024-08-31T12:17:30.549 INFO:tasks.workunit.client.0.smithi164.stdout:./119/.snap/snap-subdir-test 2024-08-31T12:17:30.559 INFO:tasks.workunit.client.0.smithi164.stdout:./297/.snap/snap-subdir-test 2024-08-31T12:17:30.573 INFO:tasks.workunit.client.0.smithi164.stdout:./230/.snap/snap-subdir-test 2024-08-31T12:17:30.754 INFO:tasks.workunit.client.0.smithi164.stdout:./260/.snap/snap-subdir-test 2024-08-31T12:17:30.767 INFO:tasks.workunit.client.0.smithi164.stdout:./157/.snap/snap-subdir-test 2024-08-31T12:17:30.779 INFO:tasks.workunit.client.0.smithi164.stdout:./172/.snap/snap-subdir-test 2024-08-31T12:17:30.789 INFO:tasks.workunit.client.0.smithi164.stdout:./277/.snap/snap-subdir-test 2024-08-31T12:17:30.801 INFO:tasks.workunit.client.0.smithi164.stdout:./186/.snap/snap-subdir-test 2024-08-31T12:17:30.815 INFO:tasks.workunit.client.0.smithi164.stdout:./237/.snap/snap-subdir-test 2024-08-31T12:17:30.827 INFO:tasks.workunit.client.0.smithi164.stdout:./190/.snap/snap-subdir-test 2024-08-31T12:17:30.840 INFO:tasks.workunit.client.0.smithi164.stdout:./213/.snap/snap-subdir-test 2024-08-31T12:17:30.853 INFO:tasks.workunit.client.0.smithi164.stdout:./104/.snap/snap-subdir-test 2024-08-31T12:17:30.865 INFO:tasks.workunit.client.0.smithi164.stdout:./164/.snap/snap-subdir-test 2024-08-31T12:17:30.878 INFO:tasks.workunit.client.0.smithi164.stdout:./112/.snap/snap-subdir-test 2024-08-31T12:17:30.888 INFO:tasks.workunit.client.0.smithi164.stdout:./295/.snap/snap-subdir-test 2024-08-31T12:17:30.898 INFO:tasks.workunit.client.0.smithi164.stdout:./272/.snap/snap-subdir-test 2024-08-31T12:17:30.910 INFO:tasks.workunit.client.0.smithi164.stdout:./100/.snap/snap-subdir-test 2024-08-31T12:17:30.923 INFO:tasks.workunit.client.0.smithi164.stdout:./134/.snap/snap-subdir-test 2024-08-31T12:17:30.936 INFO:tasks.workunit.client.0.smithi164.stdout:./200/.snap/snap-subdir-test 2024-08-31T12:17:30.949 INFO:tasks.workunit.client.0.smithi164.stdout:./115/.snap/snap-subdir-test 2024-08-31T12:17:30.959 INFO:tasks.workunit.client.0.smithi164.stdout:./284/.snap/snap-subdir-test 2024-08-31T12:17:31.219 INFO:tasks.workunit.client.0.smithi164.stdout:./280/.snap/snap-subdir-test 2024-08-31T12:17:31.233 INFO:tasks.workunit.client.0.smithi164.stdout:./116/.snap/snap-subdir-test 2024-08-31T12:17:31.246 INFO:tasks.workunit.client.0.smithi164.stdout:./245/.snap/snap-subdir-test 2024-08-31T12:17:31.258 INFO:tasks.workunit.client.0.smithi164.stdout:./195/.snap/snap-subdir-test 2024-08-31T12:17:31.271 INFO:tasks.workunit.client.0.smithi164.stdout:./138/.snap/snap-subdir-test 2024-08-31T12:17:31.283 INFO:tasks.workunit.client.0.smithi164.stdout:./135/.snap/snap-subdir-test 2024-08-31T12:17:31.296 INFO:tasks.workunit.client.0.smithi164.stdout:./117/.snap/snap-subdir-test 2024-08-31T12:17:31.307 INFO:tasks.workunit.client.0.smithi164.stdout:./241/.snap/snap-subdir-test 2024-08-31T12:17:31.319 INFO:tasks.workunit.client.0.smithi164.stdout:./143/.snap/snap-subdir-test 2024-08-31T12:17:31.331 INFO:tasks.workunit.client.0.smithi164.stdout:./180/.snap/snap-subdir-test 2024-08-31T12:17:31.344 INFO:tasks.workunit.client.0.smithi164.stdout:./126/.snap/snap-subdir-test 2024-08-31T12:17:31.356 INFO:tasks.workunit.client.0.smithi164.stdout:./161/.snap/snap-subdir-test 2024-08-31T12:17:31.368 INFO:tasks.workunit.client.0.smithi164.stdout:./204/.snap/snap-subdir-test 2024-08-31T12:17:31.381 INFO:tasks.workunit.client.0.smithi164.stdout:./176/.snap/snap-subdir-test 2024-08-31T12:17:31.390 INFO:tasks.workunit.client.0.smithi164.stdout:./255/.snap/snap-subdir-test 2024-08-31T12:17:31.403 INFO:tasks.workunit.client.0.smithi164.stdout:./215/.snap/snap-subdir-test 2024-08-31T12:17:31.416 INFO:tasks.workunit.client.0.smithi164.stdout:./111/.snap/snap-subdir-test 2024-08-31T12:17:31.429 INFO:tasks.workunit.client.0.smithi164.stdout:./238/.snap/snap-subdir-test 2024-08-31T12:17:31.442 INFO:tasks.workunit.client.0.smithi164.stdout:./191/.snap/snap-subdir-test 2024-08-31T12:17:32.050 INFO:tasks.workunit.client.0.smithi164.stdout:./184/.snap/snap-subdir-test 2024-08-31T12:17:32.064 INFO:tasks.workunit.client.0.smithi164.stdout:./192/.snap/snap-subdir-test 2024-08-31T12:17:32.078 INFO:tasks.workunit.client.0.smithi164.stdout:./103/.snap/snap-subdir-test 2024-08-31T12:17:32.370 INFO:tasks.workunit.client.0.smithi164.stdout:./128/.snap/snap-subdir-test 2024-08-31T12:17:32.384 INFO:tasks.workunit.client.0.smithi164.stdout:./229/.snap/snap-subdir-test 2024-08-31T12:17:32.397 INFO:tasks.workunit.client.0.smithi164.stdout:./144/.snap/snap-subdir-test 2024-08-31T12:17:32.410 INFO:tasks.workunit.client.0.smithi164.stdout:./146/.snap/snap-subdir-test 2024-08-31T12:17:32.423 INFO:tasks.workunit.client.0.smithi164.stdout:./227/.snap/snap-subdir-test 2024-08-31T12:17:32.433 INFO:tasks.workunit.client.0.smithi164.stdout:./278/.snap/snap-subdir-test 2024-08-31T12:17:32.446 INFO:tasks.workunit.client.0.smithi164.stdout:./141/.snap/snap-subdir-test 2024-08-31T12:17:32.460 INFO:tasks.workunit.client.0.smithi164.stdout:./234/.snap/snap-subdir-test 2024-08-31T12:17:32.473 INFO:tasks.workunit.client.0.smithi164.stdout:./225/.snap/snap-subdir-test 2024-08-31T12:17:32.486 INFO:tasks.workunit.client.0.smithi164.stdout:./182/.snap/snap-subdir-test 2024-08-31T12:17:32.499 INFO:tasks.workunit.client.0.smithi164.stdout:./107/.snap/snap-subdir-test 2024-08-31T12:17:32.512 INFO:tasks.workunit.client.0.smithi164.stdout:./178/.snap/snap-subdir-test 2024-08-31T12:17:32.774 INFO:tasks.workunit.client.0.smithi164.stdout:./266/.snap/snap-subdir-test 2024-08-31T12:17:33.038 INFO:tasks.workunit.client.0.smithi164.stdout:./240/.snap/snap-subdir-test 2024-08-31T12:17:33.051 INFO:tasks.workunit.client.0.smithi164.stdout:./156/.snap/snap-subdir-test 2024-08-31T12:17:33.064 INFO:tasks.workunit.client.0.smithi164.stdout:./131/.snap/snap-subdir-test 2024-08-31T12:17:33.078 INFO:tasks.workunit.client.0.smithi164.stdout:./123/.snap/snap-subdir-test 2024-08-31T12:17:33.341 INFO:tasks.workunit.client.0.smithi164.stdout:./160/.snap/snap-subdir-test 2024-08-31T12:17:33.354 INFO:tasks.workunit.client.0.smithi164.stdout:./165/.snap/snap-subdir-test 2024-08-31T12:17:33.367 INFO:tasks.workunit.client.0.smithi164.stdout:./101/.snap/snap-subdir-test 2024-08-31T12:17:33.380 INFO:tasks.workunit.client.0.smithi164.stdout:./148/.snap/snap-subdir-test 2024-08-31T12:17:33.395 INFO:tasks.workunit.client.0.smithi164.stdout:./168/.snap/snap-subdir-test 2024-08-31T12:17:33.409 INFO:tasks.workunit.client.0.smithi164.stdout:./179/.snap/snap-subdir-test 2024-08-31T12:17:33.419 INFO:tasks.workunit.client.0.smithi164.stdout:./257/.snap/snap-subdir-test 2024-08-31T12:17:33.429 INFO:tasks.workunit.client.0.smithi164.stdout:./252/.snap/snap-subdir-test 2024-08-31T12:17:33.442 INFO:tasks.workunit.client.0.smithi164.stdout:./132/.snap/snap-subdir-test 2024-08-31T12:17:33.455 INFO:tasks.workunit.client.0.smithi164.stdout:./236/.snap/snap-subdir-test 2024-08-31T12:17:33.468 INFO:tasks.workunit.client.0.smithi164.stdout:./211/.snap/snap-subdir-test 2024-08-31T12:17:33.481 INFO:tasks.workunit.client.0.smithi164.stdout:./199/.snap/snap-subdir-test 2024-08-31T12:17:33.495 INFO:tasks.workunit.client.0.smithi164.stdout:./205/.snap/snap-subdir-test 2024-08-31T12:17:33.508 INFO:tasks.workunit.client.0.smithi164.stdout:./163/.snap/snap-subdir-test 2024-08-31T12:17:33.518 INFO:tasks.workunit.client.0.smithi164.stdout:./261/.snap/snap-subdir-test 2024-08-31T12:17:33.531 INFO:tasks.workunit.client.0.smithi164.stdout:./201/.snap/snap-subdir-test 2024-08-31T12:17:33.542 INFO:tasks.workunit.client.0.smithi164.stdout:./282/.snap/snap-subdir-test 2024-08-31T12:17:33.552 INFO:tasks.workunit.client.0.smithi164.stdout:./296/.snap/snap-subdir-test 2024-08-31T12:17:33.564 INFO:tasks.workunit.client.0.smithi164.stdout:./217/.snap/snap-subdir-test 2024-08-31T12:17:33.576 INFO:tasks.workunit.client.0.smithi164.stdout:./153/.snap/snap-subdir-test 2024-08-31T12:17:33.841 INFO:tasks.workunit.client.0.smithi164.stdout:./206/.snap/snap-subdir-test 2024-08-31T12:17:34.008 INFO:tasks.workunit.client.0.smithi164.stdout:./122/.snap/snap-subdir-test 2024-08-31T12:17:34.023 INFO:tasks.workunit.client.0.smithi164.stdout:./162/.snap/snap-subdir-test 2024-08-31T12:17:34.037 INFO:tasks.workunit.client.0.smithi164.stdout:./197/.snap/snap-subdir-test 2024-08-31T12:17:34.122 INFO:tasks.workunit.client.0.smithi164.stdout:./216/.snap/snap-subdir-test 2024-08-31T12:17:34.861 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:17:34.864 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:17:38.296 INFO:tasks.workunit.client.0.smithi164.stdout:./254/.snap/snap-subdir-test 2024-08-31T12:17:38.313 INFO:tasks.workunit.client.0.smithi164.stdout:./113/.snap/snap-subdir-test 2024-08-31T12:17:38.330 INFO:tasks.workunit.client.0.smithi164.stdout:./152/.snap/snap-subdir-test 2024-08-31T12:17:38.348 INFO:tasks.workunit.client.0.smithi164.stdout:./121/.snap/snap-subdir-test 2024-08-31T12:17:38.365 INFO:tasks.workunit.client.0.smithi164.stdout:./118/.snap/snap-subdir-test 2024-08-31T12:17:38.382 INFO:tasks.workunit.client.0.smithi164.stdout:./196/.snap/snap-subdir-test 2024-08-31T12:17:38.399 INFO:tasks.workunit.client.0.smithi164.stdout:./124/.snap/snap-subdir-test 2024-08-31T12:17:38.416 INFO:tasks.workunit.client.0.smithi164.stdout:./239/.snap/snap-subdir-test 2024-08-31T12:17:38.433 INFO:tasks.workunit.client.0.smithi164.stdout:./188/.snap/snap-subdir-test 2024-08-31T12:17:38.444 INFO:tasks.workunit.client.0.smithi164.stdout:./287/.snap/snap-subdir-test 2024-08-31T12:17:38.454 INFO:tasks.workunit.client.0.smithi164.stdout:./275/.snap/snap-subdir-test 2024-08-31T12:17:38.463 INFO:tasks.workunit.client.0.smithi164.stdout:./259/.snap/snap-subdir-test 2024-08-31T12:17:38.476 INFO:tasks.workunit.client.0.smithi164.stdout:./224/.snap/snap-subdir-test 2024-08-31T12:17:38.486 INFO:tasks.workunit.client.0.smithi164.stdout:./264/.snap/snap-subdir-test 2024-08-31T12:17:38.499 INFO:tasks.workunit.client.0.smithi164.stdout:./145/.snap/snap-subdir-test 2024-08-31T12:17:38.763 INFO:tasks.workunit.client.0.smithi164.stdout:./279/.snap/snap-subdir-test 2024-08-31T12:17:38.773 INFO:tasks.workunit.client.0.smithi164.stdout:./263/.snap/snap-subdir-test 2024-08-31T12:17:38.786 INFO:tasks.workunit.client.0.smithi164.stdout:./130/.snap/snap-subdir-test 2024-08-31T12:17:38.798 INFO:tasks.workunit.client.0.smithi164.stdout:./193/.snap/snap-subdir-test 2024-08-31T12:17:38.811 INFO:tasks.workunit.client.0.smithi164.stdout:./223/.snap/snap-subdir-test 2024-08-31T12:17:38.827 INFO:tasks.workunit.client.0.smithi164.stdout:./207/.snap/snap-subdir-test 2024-08-31T12:17:38.841 INFO:tasks.workunit.client.0.smithi164.stdout:./276/.snap/snap-subdir-test 2024-08-31T12:17:38.851 INFO:tasks.workunit.client.0.smithi164.stdout:./271/.snap/snap-subdir-test 2024-08-31T12:17:38.862 INFO:tasks.workunit.client.0.smithi164.stdout:./251/.snap/snap-subdir-test 2024-08-31T12:17:38.876 INFO:tasks.workunit.client.0.smithi164.stdout:./175/.snap/snap-subdir-test 2024-08-31T12:17:38.889 INFO:tasks.workunit.client.0.smithi164.stdout:./222/.snap/snap-subdir-test 2024-08-31T12:17:38.901 INFO:tasks.workunit.client.0.smithi164.stdout:./220/.snap/snap-subdir-test 2024-08-31T12:17:38.914 INFO:tasks.workunit.client.0.smithi164.stdout:./203/.snap/snap-subdir-test 2024-08-31T12:17:38.928 INFO:tasks.workunit.client.0.smithi164.stdout:./181/.snap/snap-subdir-test 2024-08-31T12:17:38.938 INFO:tasks.workunit.client.0.smithi164.stdout:./286/.snap/snap-subdir-test 2024-08-31T12:17:38.950 INFO:tasks.workunit.client.0.smithi164.stdout:./127/.snap/snap-subdir-test 2024-08-31T12:17:38.963 INFO:tasks.workunit.client.0.smithi164.stdout:./108/.snap/snap-subdir-test 2024-08-31T12:17:38.975 INFO:tasks.workunit.client.0.smithi164.stdout:./183/.snap/snap-subdir-test 2024-08-31T12:17:38.985 INFO:tasks.workunit.client.0.smithi164.stdout:./294/.snap/snap-subdir-test 2024-08-31T12:17:38.998 INFO:tasks.workunit.client.0.smithi164.stdout:./235/.snap/snap-subdir-test 2024-08-31T12:17:39.010 INFO:tasks.workunit.client.0.smithi164.stdout:./177/.snap/snap-subdir-test 2024-08-31T12:17:39.026 INFO:tasks.workunit.client.0.smithi164.stdout:./169/.snap/snap-subdir-test 2024-08-31T12:17:39.042 INFO:tasks.workunit.client.0.smithi164.stdout:./212/.snap/snap-subdir-test 2024-08-31T12:17:39.058 INFO:tasks.workunit.client.0.smithi164.stdout:./154/.snap/snap-subdir-test 2024-08-31T12:17:39.075 INFO:tasks.workunit.client.0.smithi164.stdout:./171/.snap/snap-subdir-test 2024-08-31T12:17:39.092 INFO:tasks.workunit.client.0.smithi164.stdout:./139/.snap/snap-subdir-test 2024-08-31T12:17:39.109 INFO:tasks.workunit.client.0.smithi164.stdout:./102/.snap/snap-subdir-test 2024-08-31T12:17:39.126 INFO:tasks.workunit.client.0.smithi164.stdout:./129/.snap/snap-subdir-test 2024-08-31T12:17:47.234 INFO:tasks.workunit.client.0.smithi164.stdout:Delete all the files and directories ... 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/19' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/15' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/31' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/36' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/20' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/12' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/39' 2024-08-31T12:17:49.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/10' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/34' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/38' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/11' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/16' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/32' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/30' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/14' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/18' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/13' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/33' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/17' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/35' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './100/37' 2024-08-31T12:17:49.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './100' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/19' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/15' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/31' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/36' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/20' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/12' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/39' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/10' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/34' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/38' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/11' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/16' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/32' 2024-08-31T12:17:49.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/30' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/14' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/18' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/13' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/33' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/17' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/35' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './101/37' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './101' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/19' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/15' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/31' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/36' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/20' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/12' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/39' 2024-08-31T12:17:49.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/10' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/34' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/38' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/11' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/16' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/32' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/30' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/14' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/18' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/13' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/33' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/17' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/35' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './102/37' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './102' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/19' 2024-08-31T12:17:49.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/15' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/31' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/36' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/20' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/12' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/39' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/10' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/34' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/38' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/11' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/16' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/32' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/30' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/14' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/18' 2024-08-31T12:17:49.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/13' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/33' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/17' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/35' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './103/37' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './103' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/19' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/15' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/31' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/36' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/20' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/12' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/39' 2024-08-31T12:17:49.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/10' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/34' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/38' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/11' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/16' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/32' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/30' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/14' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/18' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/13' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/33' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/17' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/35' 2024-08-31T12:17:49.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './104/37' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './104' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/19' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/15' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/31' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/36' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/20' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/12' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/39' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/10' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/34' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/38' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/11' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/16' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/32' 2024-08-31T12:17:49.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/30' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/14' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/18' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/13' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/33' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/17' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/35' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './105/37' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './105' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/19' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/15' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/31' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/36' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/20' 2024-08-31T12:17:49.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/12' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/39' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/10' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/34' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/38' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/11' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/16' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/32' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/30' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/14' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/18' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/13' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/33' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/17' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/35' 2024-08-31T12:17:49.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './106/37' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './106' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/19' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/15' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/31' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/36' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/20' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/12' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/39' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/10' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/34' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/38' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/11' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/16' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/32' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/30' 2024-08-31T12:17:49.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/14' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/18' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/13' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/33' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/17' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/35' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './107/37' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './107' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/19' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/15' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/31' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/36' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/20' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/12' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/39' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/10' 2024-08-31T12:17:49.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/34' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/38' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/11' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/16' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/32' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/30' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/14' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/18' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/13' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/33' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/17' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/35' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './108/37' 2024-08-31T12:17:49.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './108' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/19' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/15' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/31' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/36' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/20' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/12' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/39' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/10' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/34' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/38' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/11' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/16' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/32' 2024-08-31T12:17:49.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/30' 2024-08-31T12:17:52.451 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/14' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/18' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/13' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/33' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/17' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/35' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './109/37' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './109' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/19' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/15' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/31' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/36' 2024-08-31T12:17:52.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/20' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/12' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/39' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/10' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/34' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/38' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/11' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/16' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/32' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/30' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/14' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/18' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/13' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/33' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/17' 2024-08-31T12:17:52.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/35' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './110/37' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './110' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/19' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/15' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/31' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/36' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/20' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/12' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/39' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/10' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/34' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/38' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/11' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/16' 2024-08-31T12:17:52.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/32' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/30' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/14' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/18' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/13' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/33' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/17' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/35' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './111/37' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './111' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/19' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/15' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/31' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/36' 2024-08-31T12:17:52.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/20' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/12' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/39' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/10' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/34' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/38' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/11' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/16' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/32' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/30' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/14' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/18' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/13' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/33' 2024-08-31T12:17:52.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/17' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/35' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './112/37' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './112' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/19' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/15' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/31' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/36' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/20' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/12' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/39' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/10' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/34' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/38' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/11' 2024-08-31T12:17:52.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/16' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/32' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/30' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/14' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/18' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/13' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/33' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/17' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/35' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './113/37' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './113' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/19' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/15' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/31' 2024-08-31T12:17:52.458 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/36' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/20' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/12' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/39' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/10' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/34' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/38' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/11' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/16' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/32' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/30' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/14' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/18' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/13' 2024-08-31T12:17:52.459 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/33' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/17' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/35' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './114/37' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './114' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/19' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/15' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/31' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/36' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/20' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/12' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/39' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/10' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/34' 2024-08-31T12:17:52.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/38' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/11' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/16' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/32' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/30' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/14' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/18' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/13' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/33' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/17' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/35' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './115/37' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './115' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/19' 2024-08-31T12:17:52.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/15' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/31' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/36' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/20' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/12' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/39' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/10' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/34' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/38' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/11' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/16' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/32' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/30' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/14' 2024-08-31T12:17:52.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/18' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/13' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/33' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/17' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/35' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './116/37' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './116' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/19' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/15' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/31' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/36' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/20' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/12' 2024-08-31T12:17:52.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/39' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/10' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/34' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/38' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/11' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/16' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/32' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/30' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/14' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/18' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/13' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/33' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/17' 2024-08-31T12:17:52.464 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/35' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './117/37' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './117' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/19' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/15' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/31' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/36' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/20' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/12' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/39' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/10' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/34' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/38' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/11' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/16' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/32' 2024-08-31T12:17:52.465 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/30' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/14' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/18' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/13' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/33' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/17' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/35' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './118/37' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './118' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/19' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/15' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/31' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/36' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/20' 2024-08-31T12:17:52.466 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/12' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/39' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/10' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/34' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/38' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/11' 2024-08-31T12:17:54.217 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/16' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/32' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/30' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/14' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/18' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/13' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/33' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/17' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/35' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './119/37' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './119' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/19' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/15' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/31' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/36' 2024-08-31T12:17:54.218 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/20' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/12' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/39' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/10' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/34' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/38' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/11' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/16' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/32' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/30' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/14' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/18' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/13' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/33' 2024-08-31T12:17:54.219 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/17' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/35' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './120/37' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './120' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/19' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/15' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/31' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/36' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/20' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/12' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/39' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/10' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/34' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/38' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/11' 2024-08-31T12:17:54.220 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/16' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/32' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/30' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/14' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/18' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/13' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/33' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/17' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/35' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './121/37' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './121' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/19' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/15' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/31' 2024-08-31T12:17:54.221 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/36' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/20' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/12' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/39' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/10' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/34' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/38' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/11' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/16' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/32' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/30' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/14' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/18' 2024-08-31T12:17:54.222 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/13' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/33' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/17' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/35' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './122/37' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './122' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/19' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/15' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/31' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/36' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/20' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/12' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/39' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/10' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/34' 2024-08-31T12:17:54.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/38' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/11' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/16' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/32' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/30' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/14' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/18' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/13' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/33' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/17' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/35' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './123/37' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './123' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/19' 2024-08-31T12:17:54.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/15' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/31' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/36' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/20' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/12' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/39' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/10' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/34' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/38' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/11' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/16' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/32' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/30' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/14' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/18' 2024-08-31T12:17:54.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/13' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/33' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/17' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/35' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './124/37' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './124' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/19' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/15' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/31' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/36' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/20' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/12' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/39' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/10' 2024-08-31T12:17:54.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/34' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/38' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/11' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/16' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/32' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/30' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/14' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/18' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/13' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/33' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/17' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/35' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './125/37' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './125' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/19' 2024-08-31T12:17:54.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/15' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/31' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/36' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/20' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/12' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/39' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/10' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/34' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/38' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/11' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/16' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/32' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/30' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/14' 2024-08-31T12:17:54.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/18' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/13' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/33' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/17' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/35' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './126/37' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './126' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/19' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/15' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/31' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/36' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/20' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/12' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/39' 2024-08-31T12:17:54.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/10' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/34' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/38' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/11' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/16' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/32' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/30' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/14' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/18' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/13' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/33' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/17' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/35' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './127/37' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './127' 2024-08-31T12:17:54.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/19' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/15' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/31' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/36' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/20' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/12' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/39' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/10' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/34' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/38' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/11' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/16' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/32' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/30' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/14' 2024-08-31T12:17:54.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/18' 2024-08-31T12:17:54.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/13' 2024-08-31T12:17:54.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/33' 2024-08-31T12:17:54.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/17' 2024-08-31T12:17:54.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/35' 2024-08-31T12:17:55.429 INFO:tasks.workunit.client.0.smithi164.stdout:removed './128/37' 2024-08-31T12:17:55.429 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './128' 2024-08-31T12:17:55.429 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/19' 2024-08-31T12:17:55.429 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/15' 2024-08-31T12:17:55.429 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/31' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/36' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/20' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/12' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/39' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/10' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/34' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/38' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/11' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/16' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/32' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/30' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/14' 2024-08-31T12:17:55.430 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/18' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/13' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/33' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/17' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/35' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './129/37' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './129' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/19' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/15' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/31' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/36' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/20' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/12' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/39' 2024-08-31T12:17:55.431 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/10' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/34' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/38' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/11' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/16' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/32' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/30' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/14' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/18' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/13' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/33' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/17' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/35' 2024-08-31T12:17:55.432 INFO:tasks.workunit.client.0.smithi164.stdout:removed './130/37' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './130' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/19' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/15' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/31' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/36' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/20' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/12' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/39' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/10' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/34' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/38' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/11' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/16' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/32' 2024-08-31T12:17:55.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/30' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/14' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/18' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/13' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/33' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/17' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/35' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './131/37' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './131' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/19' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/15' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/31' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/36' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/20' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/12' 2024-08-31T12:17:55.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/39' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/10' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/34' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/38' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/11' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/16' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/32' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/30' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/14' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/18' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/13' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/33' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/17' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/35' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './132/37' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './132' 2024-08-31T12:17:55.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/19' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/15' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/31' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/36' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/20' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/12' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/39' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/10' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/34' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/38' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/11' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/16' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/32' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/30' 2024-08-31T12:17:55.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/14' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/18' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/13' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/33' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/17' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/35' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './133/37' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './133' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/19' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/15' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/31' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/36' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/20' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/12' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/39' 2024-08-31T12:17:55.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/10' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/34' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/38' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/11' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/16' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/32' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/30' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/14' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/18' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/13' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/33' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/17' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/35' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './134/37' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './134' 2024-08-31T12:17:55.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/19' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/15' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/31' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/36' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/20' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/12' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/39' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/10' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/34' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/38' 2024-08-31T12:17:55.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/11' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/16' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/32' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/30' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/14' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/18' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/13' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/33' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/17' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/35' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './135/37' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './135' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/19' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/15' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/31' 2024-08-31T12:17:55.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/36' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/20' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/12' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/39' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/10' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/34' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/38' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/11' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/16' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/32' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/30' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/14' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/18' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/13' 2024-08-31T12:17:55.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/33' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/17' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/35' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './136/37' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './136' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/19' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/15' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/31' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/36' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/20' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/12' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/39' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/10' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/34' 2024-08-31T12:17:55.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/38' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/11' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/16' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/32' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/30' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/14' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/18' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/13' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/33' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/17' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/35' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './137/37' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './137' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/19' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/15' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/31' 2024-08-31T12:17:55.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/36' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/20' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/12' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/39' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/10' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/34' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/38' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/11' 2024-08-31T12:17:55.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/16' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/32' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/30' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/14' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/18' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/13' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/33' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/17' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/35' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './138/37' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './138' 2024-08-31T12:17:57.901 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/19' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/15' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/31' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/36' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/20' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/12' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/39' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/10' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/34' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/38' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/11' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/16' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/32' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/30' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/14' 2024-08-31T12:17:57.902 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/18' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/13' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/33' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/17' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/35' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './139/37' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './139' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/19' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/15' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/31' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/36' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/20' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/12' 2024-08-31T12:17:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/39' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/10' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/34' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/38' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/11' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/16' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/32' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/30' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/14' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/18' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/13' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/33' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/17' 2024-08-31T12:17:57.904 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/35' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './140/37' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './140' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/19' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/15' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/31' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/36' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/20' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/12' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/39' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/10' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/34' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/38' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/11' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/16' 2024-08-31T12:17:57.905 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/32' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/30' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/14' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/18' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/13' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/33' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/17' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/35' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './141/37' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './141' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/19' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/15' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/31' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/36' 2024-08-31T12:17:57.906 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/20' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/12' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/39' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/10' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/34' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/38' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/11' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/16' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/32' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/30' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/14' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/18' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/13' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/33' 2024-08-31T12:17:57.907 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/17' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/35' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './142/37' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './142' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/19' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/15' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/31' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/36' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/20' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/12' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/39' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/10' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/34' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/38' 2024-08-31T12:17:57.908 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/11' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/16' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/32' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/30' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/14' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/18' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/13' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/33' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/17' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/35' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './143/37' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './143' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/19' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/15' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/31' 2024-08-31T12:17:57.909 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/36' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/20' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/12' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/39' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/10' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/34' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/38' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/11' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/16' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/32' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/30' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/14' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/18' 2024-08-31T12:17:57.910 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/13' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/33' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/17' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/35' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './144/37' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './144' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/19' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/15' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/31' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/36' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/20' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/12' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/39' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/10' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/34' 2024-08-31T12:17:57.911 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/38' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/11' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/16' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/32' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/30' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/14' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/18' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/13' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/33' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/17' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/35' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './145/37' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './145' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/19' 2024-08-31T12:17:57.912 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/15' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/31' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/36' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/20' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/12' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/39' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/10' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/34' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/38' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/11' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/16' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/32' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/30' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/14' 2024-08-31T12:17:57.913 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/18' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/13' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/33' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/17' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/35' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './146/37' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './146' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/19' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/15' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/31' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/36' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/20' 2024-08-31T12:17:57.914 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/12' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/39' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/10' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/34' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/38' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/11' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/16' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/32' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/30' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/14' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/18' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/13' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/33' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/17' 2024-08-31T12:17:57.915 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/35' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed './147/37' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './147' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/19' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/15' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/31' 2024-08-31T12:17:57.916 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/36' 2024-08-31T12:17:58.964 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/20' 2024-08-31T12:17:58.964 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/12' 2024-08-31T12:17:58.964 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/39' 2024-08-31T12:17:58.964 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/10' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/34' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/38' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/11' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/16' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/32' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/30' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/14' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/18' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/13' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/33' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/17' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/35' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './148/37' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './148' 2024-08-31T12:17:58.965 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/19' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/15' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/31' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/36' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/20' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/12' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/39' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/10' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/34' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/38' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/11' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/16' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/32' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/30' 2024-08-31T12:17:58.966 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/14' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/18' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/13' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/33' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/17' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/35' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './149/37' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './149' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/19' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/15' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/31' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/36' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/20' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/12' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/39' 2024-08-31T12:17:58.967 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/10' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/34' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/38' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/11' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/16' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/32' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/30' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/14' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/18' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/13' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/33' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/17' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/35' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed './150/37' 2024-08-31T12:17:58.968 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './150' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/19' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/15' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/31' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/36' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/20' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/12' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/39' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/10' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/34' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/38' 2024-08-31T12:17:58.969 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/11' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/16' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/32' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/30' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/14' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/18' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/13' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/33' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/17' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/35' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './151/37' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './151' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/19' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/15' 2024-08-31T12:17:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/31' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/36' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/20' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/12' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/39' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/10' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/34' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/38' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/11' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/16' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/32' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/30' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/14' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/18' 2024-08-31T12:17:58.971 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/13' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/33' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/17' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/35' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './152/37' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './152' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/19' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/15' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/31' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/36' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/20' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/12' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/39' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/10' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/34' 2024-08-31T12:17:58.972 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/38' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/11' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/16' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/32' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/30' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/14' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/18' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/13' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/33' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/17' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/35' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './153/37' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './153' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/19' 2024-08-31T12:17:58.973 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/15' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/31' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/36' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/20' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/12' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/39' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/10' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/34' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/38' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/11' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/16' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/32' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/30' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/14' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/18' 2024-08-31T12:17:58.974 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/13' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/33' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/17' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/35' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './154/37' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './154' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/19' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/15' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/31' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/36' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/20' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/12' 2024-08-31T12:17:58.975 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/39' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/10' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/34' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/38' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/11' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/16' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/32' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/30' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/14' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/18' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/13' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/33' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/17' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/35' 2024-08-31T12:17:58.976 INFO:tasks.workunit.client.0.smithi164.stdout:removed './155/37' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './155' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/19' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/15' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/31' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/36' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/20' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/12' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/39' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/10' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/34' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/38' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/11' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/16' 2024-08-31T12:17:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/32' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/30' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/14' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/18' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/13' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/33' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/17' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/35' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './156/37' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './156' 2024-08-31T12:17:58.978 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/19' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/15' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/31' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/36' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/20' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/12' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/39' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/10' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/34' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/38' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/11' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/16' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/32' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/30' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/14' 2024-08-31T12:17:58.979 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/18' 2024-08-31T12:17:58.980 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/13' 2024-08-31T12:17:58.980 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/33' 2024-08-31T12:18:02.755 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/17' 2024-08-31T12:18:02.755 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/35' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './157/37' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './157' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/19' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/15' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/31' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/36' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/20' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/12' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/39' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/10' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/34' 2024-08-31T12:18:02.756 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/38' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/11' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/16' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/32' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/30' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/14' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/18' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/13' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/33' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/17' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/35' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './158/37' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './158' 2024-08-31T12:18:02.757 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/19' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/15' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/31' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/36' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/20' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/12' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/39' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/10' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/34' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/38' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/11' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/16' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/32' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/30' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/14' 2024-08-31T12:18:02.758 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/18' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/13' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/33' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/17' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/35' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './159/37' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './159' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/19' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/15' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/31' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/36' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/20' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/12' 2024-08-31T12:18:02.759 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/39' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/10' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/34' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/38' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/11' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/16' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/32' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/30' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/14' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/18' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/13' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/33' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/17' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/35' 2024-08-31T12:18:02.760 INFO:tasks.workunit.client.0.smithi164.stdout:removed './160/37' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './160' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/19' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/15' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/31' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/36' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/20' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/12' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/39' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/10' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/34' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/38' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/11' 2024-08-31T12:18:02.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/16' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/32' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/30' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/14' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/18' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/13' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/33' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/17' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/35' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './161/37' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './161' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/19' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/15' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/31' 2024-08-31T12:18:02.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/36' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/20' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/12' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/39' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/10' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/34' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/38' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/11' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/16' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/32' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/30' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/14' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/18' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/13' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/33' 2024-08-31T12:18:02.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/17' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/35' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './162/37' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './162' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/19' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/15' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/31' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/36' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/20' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/12' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/39' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/10' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/34' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/38' 2024-08-31T12:18:02.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/11' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/16' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/32' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/30' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/14' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/18' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/13' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/33' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/17' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/35' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './163/37' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './163' 2024-08-31T12:18:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/19' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/15' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/31' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/36' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/20' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/12' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/39' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/10' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/34' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/38' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/11' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/16' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/32' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/30' 2024-08-31T12:18:02.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/14' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/18' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/13' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/33' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/17' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/35' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './164/37' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './164' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/19' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/15' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/31' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/36' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/20' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/12' 2024-08-31T12:18:02.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/39' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/10' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/34' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/38' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/11' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/16' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/32' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/30' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/14' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/18' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/13' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/33' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/17' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/35' 2024-08-31T12:18:02.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './165/37' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './165' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/19' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/15' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/31' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/36' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/20' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/12' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/39' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/10' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/34' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/38' 2024-08-31T12:18:02.769 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/11' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/16' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/32' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/30' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/14' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/18' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/13' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/33' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/17' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/35' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './166/37' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './166' 2024-08-31T12:18:02.770 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/19' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/15' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/31' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/36' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/20' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/12' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/39' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/10' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/34' 2024-08-31T12:18:02.771 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/38' 2024-08-31T12:18:04.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:18:04.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:18:05.296 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/11' 2024-08-31T12:18:05.296 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/16' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/32' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/30' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/14' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/18' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/13' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/33' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/17' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/35' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed './167/37' 2024-08-31T12:18:05.297 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './167' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/19' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/15' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/31' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/36' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/20' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/12' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/39' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/10' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/34' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/38' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/11' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/16' 2024-08-31T12:18:05.298 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/32' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/30' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/14' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/18' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/13' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/33' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/17' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/35' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './168/37' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './168' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/19' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/15' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/31' 2024-08-31T12:18:05.299 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/36' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/20' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/12' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/39' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/10' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/34' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/38' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/11' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/16' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/32' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/30' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/14' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/18' 2024-08-31T12:18:05.300 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/13' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/33' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/17' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/35' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './169/37' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './169' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/19' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/15' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/31' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/36' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/20' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/12' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/39' 2024-08-31T12:18:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/10' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/34' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/38' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/11' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/16' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/32' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/30' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/14' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/18' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/13' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/33' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/17' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/35' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './170/37' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './170' 2024-08-31T12:18:05.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/19' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/15' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/31' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/36' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/20' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/12' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/39' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/10' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/34' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/38' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/11' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/16' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/32' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/30' 2024-08-31T12:18:05.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/14' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/18' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/13' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/33' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/17' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/35' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './171/37' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './171' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/19' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/15' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/31' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/36' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/20' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/12' 2024-08-31T12:18:05.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/39' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/10' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/34' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/38' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/11' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/16' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/32' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/30' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/14' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/18' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/13' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/33' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/17' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/35' 2024-08-31T12:18:05.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './172/37' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './172' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/19' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/15' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/31' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/36' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/20' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/12' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/39' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/10' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/34' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/38' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/11' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/16' 2024-08-31T12:18:05.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/32' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/30' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/14' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/18' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/13' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/33' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/17' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/35' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './173/37' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './173' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/19' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/15' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/31' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/36' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/20' 2024-08-31T12:18:05.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/12' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/39' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/10' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/34' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/38' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/11' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/16' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/32' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/30' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/14' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/18' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/13' 2024-08-31T12:18:05.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/33' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/17' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/35' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './174/37' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './174' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/19' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/15' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/31' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/36' 2024-08-31T12:18:05.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/20' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/12' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/39' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/10' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/34' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/38' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/11' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/16' 2024-08-31T12:18:05.310 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/32' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/30' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/14' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/18' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/13' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/33' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/17' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/35' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './175/37' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './175' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/19' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/15' 2024-08-31T12:18:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/31' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/36' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/20' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/12' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/39' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/10' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/34' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/38' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/11' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/16' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/32' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/30' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/14' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/18' 2024-08-31T12:18:05.312 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/13' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/33' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/17' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/35' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './176/37' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './176' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/19' 2024-08-31T12:18:05.313 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/15' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/31' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/36' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/20' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/12' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/39' 2024-08-31T12:18:07.534 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/10' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/34' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/38' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/11' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/16' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/32' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/30' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/14' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/18' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/13' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/33' 2024-08-31T12:18:07.535 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/17' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/35' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './177/37' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './177' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/19' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/15' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/31' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/36' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/20' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/12' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/39' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/10' 2024-08-31T12:18:07.536 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/34' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/38' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/11' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/16' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/32' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/30' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/14' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/18' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/13' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/33' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/17' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/35' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed './178/37' 2024-08-31T12:18:07.537 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './178' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/19' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/15' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/31' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/36' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/20' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/12' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/39' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/10' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/34' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/38' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/11' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/16' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/32' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/30' 2024-08-31T12:18:07.538 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/14' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/18' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/13' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/33' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/17' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/35' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './179/37' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './179' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/19' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/15' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/31' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/36' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/20' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/12' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/39' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/10' 2024-08-31T12:18:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/34' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/38' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/11' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/16' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/32' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/30' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/14' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/18' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/13' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/33' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/17' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/35' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './180/37' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './180' 2024-08-31T12:18:07.540 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/19' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/15' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/31' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/36' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/20' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/12' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/39' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/10' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/34' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/38' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/11' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/16' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/32' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/30' 2024-08-31T12:18:07.541 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/14' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/18' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/13' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/33' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/17' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/35' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './181/37' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './181' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/19' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/15' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/31' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/36' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/20' 2024-08-31T12:18:07.542 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/12' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/39' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/10' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/34' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/38' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/11' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/16' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/32' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/30' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/14' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/18' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/13' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/33' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/17' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/35' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed './182/37' 2024-08-31T12:18:07.543 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './182' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/19' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/15' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/31' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/36' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/20' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/12' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/39' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/10' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/34' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/38' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/11' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/16' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/32' 2024-08-31T12:18:07.544 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/30' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/14' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/18' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/13' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/33' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/17' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/35' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './183/37' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './183' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/19' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/15' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/31' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/36' 2024-08-31T12:18:07.545 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/20' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/12' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/39' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/10' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/34' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/38' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/11' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/16' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/32' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/30' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/14' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/18' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/13' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/33' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/17' 2024-08-31T12:18:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/35' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './184/37' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './184' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/19' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/15' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/31' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/36' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/20' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/12' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/39' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/10' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/34' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/38' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/11' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/16' 2024-08-31T12:18:07.547 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/32' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/30' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/14' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/18' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/13' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/33' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/17' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/35' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './185/37' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './185' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/19' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/15' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/31' 2024-08-31T12:18:07.548 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/36' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/20' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/12' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/39' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/10' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/34' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/38' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/11' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/16' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/32' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/30' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/14' 2024-08-31T12:18:07.549 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/18' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/13' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/33' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/17' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/35' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './186/37' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './186' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/19' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/15' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/31' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/36' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/20' 2024-08-31T12:18:09.339 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/12' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/39' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/10' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/34' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/38' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/11' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/16' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/32' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/30' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/14' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/18' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/13' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/33' 2024-08-31T12:18:09.340 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/17' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/35' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './187/37' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './187' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/19' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/15' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/31' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/36' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/20' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/12' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/39' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/10' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/34' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/38' 2024-08-31T12:18:09.341 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/11' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/16' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/32' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/30' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/14' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/18' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/13' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/33' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/17' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/35' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './188/37' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './188' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/19' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/15' 2024-08-31T12:18:09.342 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/31' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/36' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/20' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/12' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/39' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/10' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/34' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/38' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/11' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/16' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/32' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/30' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/14' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/18' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/13' 2024-08-31T12:18:09.343 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/33' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/17' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/35' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './189/37' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './189' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/19' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/15' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/31' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/36' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/20' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/12' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/39' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/10' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/34' 2024-08-31T12:18:09.344 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/38' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/11' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/16' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/32' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/30' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/14' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/18' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/13' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/33' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/17' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/35' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './190/37' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './190' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/19' 2024-08-31T12:18:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/15' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/31' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/36' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/20' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/12' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/39' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/10' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/34' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/38' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/11' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/16' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/32' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/30' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/14' 2024-08-31T12:18:09.346 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/18' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/13' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/33' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/17' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/35' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './191/37' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './191' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/19' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/15' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/31' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/36' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/20' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/12' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/39' 2024-08-31T12:18:09.347 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/10' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/34' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/38' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/11' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/16' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/32' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/30' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/14' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/18' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/13' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/33' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/17' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/35' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './192/37' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './192' 2024-08-31T12:18:09.348 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/19' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/15' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/31' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/36' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/20' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/12' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/39' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/10' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/34' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/38' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/11' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/16' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/32' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/30' 2024-08-31T12:18:09.349 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/14' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/18' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/13' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/33' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/17' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/35' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './193/37' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './193' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/19' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/15' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/31' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/36' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/20' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/12' 2024-08-31T12:18:09.350 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/39' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/10' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/34' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/38' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/11' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/16' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/32' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/30' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/14' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/18' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/13' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/33' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/17' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/35' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed './194/37' 2024-08-31T12:18:09.351 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './194' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/19' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/15' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/31' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/36' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/20' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/12' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/39' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/10' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/34' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/38' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/11' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/16' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/32' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/30' 2024-08-31T12:18:09.352 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/14' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/18' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/13' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/33' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/17' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/35' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './195/37' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './195' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/19' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/15' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/31' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/36' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/20' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/12' 2024-08-31T12:18:09.353 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/39' 2024-08-31T12:18:09.354 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/10' 2024-08-31T12:18:10.986 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/34' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/38' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/11' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/16' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/32' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/30' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/14' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/18' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/13' 2024-08-31T12:18:10.987 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/33' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/17' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/35' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './196/37' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './196' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/19' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/15' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/31' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/36' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/20' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/12' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/39' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/10' 2024-08-31T12:18:10.988 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/34' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/38' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/11' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/16' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/32' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/30' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/14' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/18' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/13' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/33' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/17' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/35' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed './197/37' 2024-08-31T12:18:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './197' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/19' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/15' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/31' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/36' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/20' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/12' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/39' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/10' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/34' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/38' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/11' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/16' 2024-08-31T12:18:10.990 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/32' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/30' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/14' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/18' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/13' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/33' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/17' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/35' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './198/37' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './198' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/19' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/15' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/31' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/36' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/20' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/12' 2024-08-31T12:18:10.991 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/39' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/10' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/34' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/38' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/11' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/16' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/32' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/30' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/14' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/18' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/13' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/33' 2024-08-31T12:18:10.992 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/17' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/35' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './199/37' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './199' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/21' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/27' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/31' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/36' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/20' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/39' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/34' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/38' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/28' 2024-08-31T12:18:10.993 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/24' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/29' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/32' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/22' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/25' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/30' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/33' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/23' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/35' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/26' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './200/37' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './200' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/21' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/27' 2024-08-31T12:18:10.994 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/31' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/36' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/20' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/39' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/34' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/38' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/28' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/24' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/29' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/32' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/22' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/25' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/30' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/33' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/23' 2024-08-31T12:18:10.995 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/35' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/26' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './201/37' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './201' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/21' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/27' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/31' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/36' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/20' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/39' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/34' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/38' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/28' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/24' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/29' 2024-08-31T12:18:10.996 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/32' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/22' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/25' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/30' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/33' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/23' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/35' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/26' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './202/37' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './202' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/21' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/27' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/31' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/36' 2024-08-31T12:18:10.997 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/20' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/39' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/34' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/38' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/28' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/24' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/29' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/32' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/22' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/25' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/30' 2024-08-31T12:18:10.998 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/33' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/23' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/35' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/26' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './203/37' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './203' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/21' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/27' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/31' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/36' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/20' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/39' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/34' 2024-08-31T12:18:10.999 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/38' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/28' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/24' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/29' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/32' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/22' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/25' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/30' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/33' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/23' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/35' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/26' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './204/37' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './204' 2024-08-31T12:18:11.000 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/21' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/27' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/31' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/36' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/20' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/39' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/34' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/38' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/28' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/24' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/29' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/32' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/22' 2024-08-31T12:18:11.001 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/25' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/30' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/33' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/23' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/35' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/26' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './205/37' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './205' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/21' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/27' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/31' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/36' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/20' 2024-08-31T12:18:11.002 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/39' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/34' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/38' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/28' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/24' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/29' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/32' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/22' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/25' 2024-08-31T12:18:13.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/30' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/33' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/23' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/35' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/26' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './206/37' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './206' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/21' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/27' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/31' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/36' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/20' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/39' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/34' 2024-08-31T12:18:13.232 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/38' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/28' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/24' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/29' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/32' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/22' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/25' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/30' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/33' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/23' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/35' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/26' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './207/37' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './207' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/21' 2024-08-31T12:18:13.233 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/27' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/31' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/36' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/20' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/39' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/34' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/38' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/28' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/24' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/29' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/32' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/22' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/25' 2024-08-31T12:18:13.234 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/30' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/33' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/23' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/35' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/26' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './208/37' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './208' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/21' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/27' 2024-08-31T12:18:13.235 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/31' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/36' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/20' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/39' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/34' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/38' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/28' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/24' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/29' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/32' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/22' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/25' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/30' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/33' 2024-08-31T12:18:13.236 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/23' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/35' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/26' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './209/37' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './209' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/21' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/27' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/31' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/36' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/20' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/39' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/34' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/38' 2024-08-31T12:18:13.237 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/28' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/24' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/29' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/32' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/22' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/25' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/30' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/33' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/23' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/35' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/26' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './210/37' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './210' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/21' 2024-08-31T12:18:13.238 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/27' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/31' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/36' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/20' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/39' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/34' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/38' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/28' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/24' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/29' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/32' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/22' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/25' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/30' 2024-08-31T12:18:13.239 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/33' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/23' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/35' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/26' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './211/37' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './211' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/21' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/27' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/31' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/36' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/20' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/39' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/34' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/38' 2024-08-31T12:18:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/28' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/24' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/29' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/32' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/22' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/25' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/30' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/33' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/23' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/35' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/26' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './212/37' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './212' 2024-08-31T12:18:13.241 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/21' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/27' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/31' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/36' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/20' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/39' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/34' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/38' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/28' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/24' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/29' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/32' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/22' 2024-08-31T12:18:13.242 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/25' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/30' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/33' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/23' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/35' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/26' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './213/37' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './213' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/21' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/27' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/31' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/36' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/20' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/39' 2024-08-31T12:18:13.243 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/34' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/38' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/28' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/24' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/29' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/32' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/22' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/25' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/30' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/33' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/23' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/35' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/26' 2024-08-31T12:18:13.244 INFO:tasks.workunit.client.0.smithi164.stdout:removed './214/37' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './214' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/21' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/27' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/31' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/36' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/20' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/39' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/34' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/38' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/28' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/24' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/29' 2024-08-31T12:18:13.245 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/32' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/22' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/25' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/30' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/33' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/23' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/35' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/26' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './215/37' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './215' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/21' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/27' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/31' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/36' 2024-08-31T12:18:13.246 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/20' 2024-08-31T12:18:13.247 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/39' 2024-08-31T12:18:13.247 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/34' 2024-08-31T12:18:13.247 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/38' 2024-08-31T12:18:14.627 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/28' 2024-08-31T12:18:14.627 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/24' 2024-08-31T12:18:14.627 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/29' 2024-08-31T12:18:14.627 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/32' 2024-08-31T12:18:14.627 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/22' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/25' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/30' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/33' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/23' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/35' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/26' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './216/37' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './216' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/21' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/27' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/31' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/36' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/20' 2024-08-31T12:18:14.628 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/39' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/34' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/38' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/28' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/24' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/29' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/32' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/22' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/25' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/30' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/33' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/23' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/35' 2024-08-31T12:18:14.629 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/26' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './217/37' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './217' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/21' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/27' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/31' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/36' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/20' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/39' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/34' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/38' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/28' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/24' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/29' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/32' 2024-08-31T12:18:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/22' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/25' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/30' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/33' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/23' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/35' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/26' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './218/37' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './218' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/21' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/27' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/31' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/36' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/20' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/39' 2024-08-31T12:18:14.631 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/34' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/38' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/28' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/24' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/29' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/32' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/22' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/25' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/30' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/33' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/23' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/35' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/26' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed './219/37' 2024-08-31T12:18:14.632 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './219' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/21' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/27' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/31' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/36' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/20' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/39' 2024-08-31T12:18:14.633 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/34' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/38' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/28' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/24' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/29' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/32' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/22' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/25' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/30' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/33' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/23' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/35' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/26' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed './220/37' 2024-08-31T12:18:14.634 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './220' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/21' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/27' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/31' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/36' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/20' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/39' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/34' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/38' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/28' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/24' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/29' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/32' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/22' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/25' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/30' 2024-08-31T12:18:14.635 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/33' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/23' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/35' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/26' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './221/37' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './221' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/21' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/27' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/31' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/36' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/20' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/39' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/34' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/38' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/28' 2024-08-31T12:18:14.636 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/24' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/29' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/32' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/22' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/25' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/30' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/33' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/23' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/35' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/26' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './222/37' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './222' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/21' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/27' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/31' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/36' 2024-08-31T12:18:14.637 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/20' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/39' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/34' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/38' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/28' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/24' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/29' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/32' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/22' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/25' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/30' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/33' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/23' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/35' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/26' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed './223/37' 2024-08-31T12:18:14.638 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './223' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/21' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/27' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/31' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/36' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/20' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/39' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/34' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/38' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/28' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/24' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/29' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/32' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/22' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/25' 2024-08-31T12:18:14.639 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/30' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/33' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/23' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/35' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/26' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './224/37' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './224' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/21' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/27' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/31' 2024-08-31T12:18:14.640 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/36' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/20' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/39' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/34' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/38' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/28' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/24' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/29' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/32' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/22' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/25' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/30' 2024-08-31T12:18:14.641 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/33' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/23' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/35' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/26' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './225/37' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './225' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/21' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/27' 2024-08-31T12:18:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/31' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/36' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/20' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/39' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/34' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/38' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/28' 2024-08-31T12:18:14.643 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/24' 2024-08-31T12:18:16.859 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/29' 2024-08-31T12:18:16.859 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/32' 2024-08-31T12:18:16.859 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/22' 2024-08-31T12:18:16.859 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/25' 2024-08-31T12:18:16.859 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/30' 2024-08-31T12:18:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/33' 2024-08-31T12:18:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/23' 2024-08-31T12:18:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/35' 2024-08-31T12:18:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/26' 2024-08-31T12:18:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:removed './226/37' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './226' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/21' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/27' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/31' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/36' 2024-08-31T12:18:16.861 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/20' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/39' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/34' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/38' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/28' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/24' 2024-08-31T12:18:16.862 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/29' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/32' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/22' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/25' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/30' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/33' 2024-08-31T12:18:16.863 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/23' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/35' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/26' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './227/37' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './227' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/21' 2024-08-31T12:18:16.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/27' 2024-08-31T12:18:16.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/31' 2024-08-31T12:18:16.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/36' 2024-08-31T12:18:16.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/20' 2024-08-31T12:18:16.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/39' 2024-08-31T12:18:16.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/34' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/38' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/28' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/24' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/29' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/32' 2024-08-31T12:18:16.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/22' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/25' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/30' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/33' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/23' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/35' 2024-08-31T12:18:16.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/26' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './228/37' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './228' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/21' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/27' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/31' 2024-08-31T12:18:16.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/36' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/20' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/39' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/34' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/38' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/28' 2024-08-31T12:18:16.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/24' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/29' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/32' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/22' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/25' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/30' 2024-08-31T12:18:16.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/33' 2024-08-31T12:18:16.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/23' 2024-08-31T12:18:16.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/35' 2024-08-31T12:18:16.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/26' 2024-08-31T12:18:16.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './229/37' 2024-08-31T12:18:16.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './229' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/21' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/27' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/31' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/36' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/20' 2024-08-31T12:18:16.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/39' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/34' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/38' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/28' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/24' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/29' 2024-08-31T12:18:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/32' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/22' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/25' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/30' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/33' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/23' 2024-08-31T12:18:16.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/35' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/26' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './230/37' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './230' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/21' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/27' 2024-08-31T12:18:16.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/31' 2024-08-31T12:18:16.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/36' 2024-08-31T12:18:16.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/20' 2024-08-31T12:18:16.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/39' 2024-08-31T12:18:16.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/34' 2024-08-31T12:18:16.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/38' 2024-08-31T12:18:16.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/28' 2024-08-31T12:18:16.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/24' 2024-08-31T12:18:16.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/29' 2024-08-31T12:18:16.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/32' 2024-08-31T12:18:16.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/22' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/25' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/30' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/33' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/23' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/35' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/26' 2024-08-31T12:18:16.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './231/37' 2024-08-31T12:18:16.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './231' 2024-08-31T12:18:16.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/21' 2024-08-31T12:18:16.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/27' 2024-08-31T12:18:16.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/31' 2024-08-31T12:18:16.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/36' 2024-08-31T12:18:16.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/20' 2024-08-31T12:18:16.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/39' 2024-08-31T12:18:16.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/34' 2024-08-31T12:18:16.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/38' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/28' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/24' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/29' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/32' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/22' 2024-08-31T12:18:16.881 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/25' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/30' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/33' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/23' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/35' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/26' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './232/37' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './232' 2024-08-31T12:18:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/21' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/27' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/31' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/36' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/20' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/39' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/34' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/38' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/28' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/24' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/29' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/32' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/22' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/25' 2024-08-31T12:18:16.883 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/30' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/33' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/23' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/35' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/26' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './233/37' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './233' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/21' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/27' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/31' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/36' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/20' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/39' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/34' 2024-08-31T12:18:16.884 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/38' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/28' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/24' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/29' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/32' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/22' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/25' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/30' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/33' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/23' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/35' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/26' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './234/37' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './234' 2024-08-31T12:18:16.885 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/21' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/27' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/31' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/36' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/20' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/39' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/34' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/38' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/28' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/24' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/29' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/32' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/22' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/25' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/30' 2024-08-31T12:18:16.886 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/33' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/23' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/35' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/26' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './235/37' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './235' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/21' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/27' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/31' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/36' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/20' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/39' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/34' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/38' 2024-08-31T12:18:16.887 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/28' 2024-08-31T12:18:16.888 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/24' 2024-08-31T12:18:16.888 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/29' 2024-08-31T12:18:16.888 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/32' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/22' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/25' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/30' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/33' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/23' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/35' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/26' 2024-08-31T12:18:17.864 INFO:tasks.workunit.client.0.smithi164.stdout:removed './236/37' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './236' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/21' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/27' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/31' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/36' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/20' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/39' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/34' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/38' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/28' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/24' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/29' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/32' 2024-08-31T12:18:17.865 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/22' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/25' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/30' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/33' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/23' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/35' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/26' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './237/37' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './237' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/21' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/27' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/31' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/36' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/20' 2024-08-31T12:18:17.866 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/39' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/34' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/38' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/28' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/24' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/29' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/32' 2024-08-31T12:18:17.867 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/22' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/25' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/30' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/33' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/23' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/35' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/26' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './238/37' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './238' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/21' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/27' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/31' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/36' 2024-08-31T12:18:17.868 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/20' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/39' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/34' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/38' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/28' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/24' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/29' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/32' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/22' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/25' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/30' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/33' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/23' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/35' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/26' 2024-08-31T12:18:17.869 INFO:tasks.workunit.client.0.smithi164.stdout:removed './239/37' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './239' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/21' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/27' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/31' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/36' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/20' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/39' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/34' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/38' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/28' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/24' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/29' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/32' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/22' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/25' 2024-08-31T12:18:17.870 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/30' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/33' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/23' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/35' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/26' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './240/37' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './240' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/21' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/27' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/31' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/36' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/20' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/39' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/34' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/38' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/28' 2024-08-31T12:18:17.871 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/24' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/29' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/32' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/22' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/25' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/30' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/33' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/23' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/35' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/26' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './241/37' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './241' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/21' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/27' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/31' 2024-08-31T12:18:17.872 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/36' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/20' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/39' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/34' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/38' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/28' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/24' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/29' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/32' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/22' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/25' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/30' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/33' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/23' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/35' 2024-08-31T12:18:17.873 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/26' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './242/37' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './242' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/21' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/27' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/31' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/36' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/20' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/39' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/34' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/38' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/28' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/24' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/29' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/32' 2024-08-31T12:18:17.874 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/22' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/25' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/30' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/33' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/23' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/35' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/26' 2024-08-31T12:18:17.875 INFO:tasks.workunit.client.0.smithi164.stdout:removed './243/37' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './243' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/21' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/27' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/31' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/36' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/20' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/39' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/34' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/38' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/28' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/24' 2024-08-31T12:18:17.876 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/29' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/32' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/22' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/25' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/30' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/33' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/23' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/35' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/26' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './244/37' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './244' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/21' 2024-08-31T12:18:17.877 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/27' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/31' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/36' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/20' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/39' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/34' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/38' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/28' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/24' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/29' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/32' 2024-08-31T12:18:17.878 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/22' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/25' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/30' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/33' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/23' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/35' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/26' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './245/37' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './245' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/21' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/27' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/31' 2024-08-31T12:18:17.879 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/36' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/20' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/39' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/34' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/38' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/28' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/24' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/29' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/32' 2024-08-31T12:18:17.880 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/22' 2024-08-31T12:18:19.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/25' 2024-08-31T12:18:19.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/30' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/33' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/23' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/35' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/26' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './246/37' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './246' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/21' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/27' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/31' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/36' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/20' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/39' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/34' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/38' 2024-08-31T12:18:19.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/28' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/24' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/29' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/32' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/22' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/25' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/30' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/33' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/23' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/35' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/26' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './247/37' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './247' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/21' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/27' 2024-08-31T12:18:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/31' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/36' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/20' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/39' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/34' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/38' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/28' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/24' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/29' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/32' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/22' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/25' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/30' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/33' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/23' 2024-08-31T12:18:19.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/35' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/26' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './248/37' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './248' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/21' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/27' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/31' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/36' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/20' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/39' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/34' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/38' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/28' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/24' 2024-08-31T12:18:19.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/29' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/32' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/22' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/25' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/30' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/33' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/23' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/35' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/26' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './249/37' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './249' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/21' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/27' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/31' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/36' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/20' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/39' 2024-08-31T12:18:19.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/34' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/38' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/28' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/24' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/29' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/32' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/22' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/25' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/30' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/33' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/23' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/35' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/26' 2024-08-31T12:18:19.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './250/37' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './250' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/21' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/27' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/31' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/36' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/20' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/39' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/34' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/38' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/28' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/24' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/29' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/32' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/22' 2024-08-31T12:18:19.500 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/25' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/30' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/33' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/23' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/35' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/26' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './251/37' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './251' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/21' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/27' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/31' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/36' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/20' 2024-08-31T12:18:19.501 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/39' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/34' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/38' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/28' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/24' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/29' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/32' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/22' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/25' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/30' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/33' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/23' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/35' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/26' 2024-08-31T12:18:19.502 INFO:tasks.workunit.client.0.smithi164.stdout:removed './252/37' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './252' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/21' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/27' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/31' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/36' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/20' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/39' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/34' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/38' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/28' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/24' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/29' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/32' 2024-08-31T12:18:19.503 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/22' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/25' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/30' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/33' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/23' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/35' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/26' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './253/37' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './253' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/21' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/27' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/31' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/36' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/20' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/39' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/34' 2024-08-31T12:18:19.504 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/38' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/28' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/24' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/29' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/32' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/22' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/25' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/30' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/33' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/23' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/35' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/26' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './254/37' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './254' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/21' 2024-08-31T12:18:19.505 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/27' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/31' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/36' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/20' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/39' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/34' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/38' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/28' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/24' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/29' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/32' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/22' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/25' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/30' 2024-08-31T12:18:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/33' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/23' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/35' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/26' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './255/37' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './255' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/21' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/27' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/31' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/36' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/20' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/39' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/34' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/38' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/28' 2024-08-31T12:18:19.507 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/24' 2024-08-31T12:18:19.508 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/29' 2024-08-31T12:18:19.508 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/32' 2024-08-31T12:18:19.508 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/22' 2024-08-31T12:18:19.508 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/25' 2024-08-31T12:18:19.508 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/30' 2024-08-31T12:18:21.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/33' 2024-08-31T12:18:21.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/23' 2024-08-31T12:18:21.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/35' 2024-08-31T12:18:21.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/26' 2024-08-31T12:18:21.433 INFO:tasks.workunit.client.0.smithi164.stdout:removed './256/37' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './256' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/21' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/27' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/31' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/36' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/20' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/39' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/34' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/38' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/28' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/24' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/29' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/32' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/22' 2024-08-31T12:18:21.434 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/25' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/30' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/33' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/23' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/35' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/26' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './257/37' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './257' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/21' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/27' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/31' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/36' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/20' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/39' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/34' 2024-08-31T12:18:21.435 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/38' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/28' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/24' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/29' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/32' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/22' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/25' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/30' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/33' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/23' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/35' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/26' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './258/37' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './258' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/21' 2024-08-31T12:18:21.436 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/27' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/31' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/36' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/20' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/39' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/34' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/38' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/28' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/24' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/29' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/32' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/22' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/25' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/30' 2024-08-31T12:18:21.437 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/33' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/23' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/35' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/26' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './259/37' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './259' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/21' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/27' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/31' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/36' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/20' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/39' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/34' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/38' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/28' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/24' 2024-08-31T12:18:21.438 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/29' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/32' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/22' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/25' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/30' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/33' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/23' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/35' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/26' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './260/37' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './260' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/21' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/27' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/31' 2024-08-31T12:18:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/36' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/20' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/39' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/34' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/38' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/28' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/24' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/29' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/32' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/22' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/25' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/30' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/33' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/23' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/35' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/26' 2024-08-31T12:18:21.440 INFO:tasks.workunit.client.0.smithi164.stdout:removed './261/37' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './261' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/21' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/27' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/31' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/36' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/20' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/39' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/34' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/38' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/28' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/24' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/29' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/32' 2024-08-31T12:18:21.441 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/22' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/25' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/30' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/33' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/23' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/35' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/26' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './262/37' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './262' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/21' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/27' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/31' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/36' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/20' 2024-08-31T12:18:21.442 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/39' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/34' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/38' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/28' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/24' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/29' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/32' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/22' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/25' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/30' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/33' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/23' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/35' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/26' 2024-08-31T12:18:21.443 INFO:tasks.workunit.client.0.smithi164.stdout:removed './263/37' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './263' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/21' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/27' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/31' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/36' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/20' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/39' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/34' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/38' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/28' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/24' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/29' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/32' 2024-08-31T12:18:21.444 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/22' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/25' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/30' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/33' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/23' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/35' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/26' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './264/37' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './264' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/21' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/27' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/31' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/36' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/20' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/39' 2024-08-31T12:18:21.445 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/34' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/38' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/28' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/24' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/29' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/32' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/22' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/25' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/30' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/33' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/23' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/35' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/26' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed './265/37' 2024-08-31T12:18:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './265' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/21' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/27' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/31' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/36' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/20' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/39' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/34' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/38' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/28' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/24' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/29' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/32' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/22' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/25' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/30' 2024-08-31T12:18:21.447 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/33' 2024-08-31T12:18:21.448 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/23' 2024-08-31T12:18:24.801 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/35' 2024-08-31T12:18:24.801 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/26' 2024-08-31T12:18:24.801 INFO:tasks.workunit.client.0.smithi164.stdout:removed './266/37' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './266' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/21' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/27' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/31' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/36' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/20' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/39' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/34' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/38' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/28' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/24' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/29' 2024-08-31T12:18:24.802 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/32' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/22' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/25' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/30' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/33' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/23' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/35' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/26' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './267/37' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './267' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/21' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/27' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/31' 2024-08-31T12:18:24.803 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/36' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/20' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/39' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/34' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/38' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/28' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/24' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/29' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/32' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/22' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/25' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/30' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/33' 2024-08-31T12:18:24.804 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/23' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/35' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/26' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './268/37' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './268' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/21' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/27' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/31' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/36' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/20' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/39' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/34' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/38' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/28' 2024-08-31T12:18:24.805 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/24' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/29' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/32' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/22' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/25' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/30' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/33' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/23' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/35' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/26' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './269/37' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './269' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/21' 2024-08-31T12:18:24.806 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/27' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/31' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/36' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/20' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/39' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/34' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/38' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/28' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/24' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/29' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/32' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/22' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/25' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/30' 2024-08-31T12:18:24.807 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/33' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/23' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/35' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/26' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './270/37' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './270' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/21' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/27' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/31' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/36' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/20' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/39' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/34' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/38' 2024-08-31T12:18:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/28' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/24' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/29' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/32' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/22' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/25' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/30' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/33' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/23' 2024-08-31T12:18:24.809 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/35' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/26' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './271/37' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './271' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/21' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/27' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/31' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/36' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/20' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/39' 2024-08-31T12:18:24.810 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/34' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/38' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/28' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/24' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/29' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/32' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/22' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/25' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/30' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/33' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/23' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/35' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/26' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed './272/37' 2024-08-31T12:18:24.811 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './272' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/21' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/27' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/31' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/36' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/20' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/39' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/34' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/38' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/28' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/24' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/29' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/32' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/22' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/25' 2024-08-31T12:18:24.812 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/30' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/33' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/23' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/35' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/26' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './273/37' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './273' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/21' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/27' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/31' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/36' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/20' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/39' 2024-08-31T12:18:24.813 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/34' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/38' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/28' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/24' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/29' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/32' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/22' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/25' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/30' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/33' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/23' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/35' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/26' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed './274/37' 2024-08-31T12:18:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './274' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/21' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/27' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/31' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/36' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/20' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/39' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/34' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/38' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/28' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/24' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/29' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/32' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/22' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/25' 2024-08-31T12:18:24.815 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/30' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/33' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/23' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/35' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/26' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './275/37' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './275' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/21' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/27' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/31' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/36' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/20' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/39' 2024-08-31T12:18:24.816 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/34' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/38' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/28' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/24' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/29' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/32' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/22' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/25' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/30' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/33' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/23' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/35' 2024-08-31T12:18:24.817 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/26' 2024-08-31T12:18:27.658 INFO:tasks.workunit.client.0.smithi164.stdout:removed './276/37' 2024-08-31T12:18:27.658 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './276' 2024-08-31T12:18:27.658 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/21' 2024-08-31T12:18:27.658 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/27' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/31' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/36' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/20' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/39' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/34' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/38' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/28' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/24' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/29' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/32' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/22' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/25' 2024-08-31T12:18:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/30' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/33' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/23' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/35' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/26' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './277/37' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './277' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/21' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/27' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/31' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/36' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/20' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/39' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/34' 2024-08-31T12:18:27.660 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/38' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/28' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/24' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/29' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/32' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/22' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/25' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/30' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/33' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/23' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/35' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/26' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './278/37' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './278' 2024-08-31T12:18:27.661 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/21' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/27' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/31' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/36' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/20' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/39' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/34' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/38' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/28' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/24' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/29' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/32' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/22' 2024-08-31T12:18:27.662 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/25' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/30' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/33' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/23' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/35' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/26' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './279/37' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './279' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/21' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/27' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/31' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/36' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/20' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/39' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/34' 2024-08-31T12:18:27.663 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/38' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/28' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/24' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/29' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/32' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/22' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/25' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/30' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/33' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/23' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/35' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/26' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './280/37' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './280' 2024-08-31T12:18:27.664 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/21' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/27' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/31' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/36' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/20' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/39' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/34' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/38' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/28' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/24' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/29' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/32' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/22' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/25' 2024-08-31T12:18:27.665 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/30' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/33' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/23' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/35' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/26' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './281/37' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './281' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/21' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/27' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/31' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/36' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/20' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/39' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/34' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/38' 2024-08-31T12:18:27.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/28' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/24' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/29' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/32' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/22' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/25' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/30' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/33' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/23' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/35' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/26' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './282/37' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './282' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/21' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/27' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/31' 2024-08-31T12:18:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/36' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/20' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/39' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/34' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/38' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/28' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/24' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/29' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/32' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/22' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/25' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/30' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/33' 2024-08-31T12:18:27.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/23' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/35' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/26' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './283/37' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './283' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/21' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/27' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/31' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/36' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/20' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/39' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/34' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/38' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/28' 2024-08-31T12:18:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/24' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/29' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/32' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/22' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/25' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/30' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/33' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/23' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/35' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/26' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './284/37' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './284' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/21' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/27' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/31' 2024-08-31T12:18:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/36' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/20' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/39' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/34' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/38' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/28' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/24' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/29' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/32' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/22' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/25' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/30' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/33' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/23' 2024-08-31T12:18:27.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/35' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/26' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './285/37' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './285' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/21' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/27' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/31' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/36' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/20' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/39' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/34' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/38' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/28' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/24' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/29' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/32' 2024-08-31T12:18:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/22' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/25' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/30' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/33' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/23' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/35' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/26' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './286/37' 2024-08-31T12:18:27.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './286' 2024-08-31T12:18:34.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/21' 2024-08-31T12:18:34.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/27' 2024-08-31T12:18:34.666 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/31' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/36' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/20' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/39' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/34' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/38' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/28' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/24' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/29' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/32' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/22' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/25' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/30' 2024-08-31T12:18:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/33' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/23' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/35' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/26' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './287/37' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './287' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/21' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/27' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/31' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/36' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/20' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/39' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/34' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/38' 2024-08-31T12:18:34.668 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/28' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/24' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/29' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/32' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/22' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/25' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/30' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/33' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/23' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/35' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/26' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './288/37' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './288' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/21' 2024-08-31T12:18:34.669 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/27' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/31' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/36' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/20' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/39' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/34' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/38' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/28' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/24' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/29' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/32' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/22' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/25' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/30' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/33' 2024-08-31T12:18:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/23' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/35' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/26' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './289/37' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './289' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/21' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/27' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/31' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/36' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/20' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/39' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/34' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/38' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/28' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/24' 2024-08-31T12:18:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/29' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/32' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/22' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/25' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/30' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/33' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/23' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/35' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/26' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './290/37' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './290' 2024-08-31T12:18:34.672 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/21' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/27' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/31' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/36' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/20' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/39' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/34' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/38' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/28' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/24' 2024-08-31T12:18:34.673 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/29' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/32' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/22' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/25' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/30' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/33' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/23' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/35' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/26' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './291/37' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './291' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/21' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/27' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/31' 2024-08-31T12:18:34.674 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/36' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/20' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/39' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/34' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/38' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/28' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/24' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/29' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/32' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/22' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/25' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/30' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/33' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/23' 2024-08-31T12:18:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/35' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/26' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './292/37' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './292' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/21' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/27' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/31' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/36' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/20' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/39' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/34' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/38' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/28' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/24' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/29' 2024-08-31T12:18:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/32' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/22' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/25' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/30' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/33' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/23' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/35' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/26' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './293/37' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './293' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/21' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/27' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/31' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/36' 2024-08-31T12:18:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/20' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/39' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/34' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/38' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/28' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/24' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/29' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/32' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/22' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/25' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/30' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/33' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/23' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/35' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/26' 2024-08-31T12:18:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:removed './294/37' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './294' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/21' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/27' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/31' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/36' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/20' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/39' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/34' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/38' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/28' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/24' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/29' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/32' 2024-08-31T12:18:34.679 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/22' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/25' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/30' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/33' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/23' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/35' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/26' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './295/37' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './295' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/21' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/27' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/31' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/36' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/20' 2024-08-31T12:18:34.680 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/39' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/34' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/38' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/28' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/24' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/29' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/32' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/22' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/25' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/30' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/33' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/23' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/35' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/26' 2024-08-31T12:18:34.681 INFO:tasks.workunit.client.0.smithi164.stdout:removed './296/37' 2024-08-31T12:18:34.682 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './296' 2024-08-31T12:18:34.682 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/21' 2024-08-31T12:18:34.682 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/27' 2024-08-31T12:18:34.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:18:34.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:18:37.488 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/31' 2024-08-31T12:18:37.488 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/36' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/20' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/39' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/34' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/38' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/28' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/24' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/29' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/32' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/22' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/25' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/30' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/33' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/23' 2024-08-31T12:18:37.489 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/35' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/26' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './297/37' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './297' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/21' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/27' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/31' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/36' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/20' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/39' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/34' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/38' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/28' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/24' 2024-08-31T12:18:37.490 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/29' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/32' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/22' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/25' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/30' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/33' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/23' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/35' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/26' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './298/37' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './298' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/21' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/27' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/31' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/36' 2024-08-31T12:18:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/20' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/39' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/34' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/38' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/28' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/24' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/29' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/32' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/22' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/25' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/30' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/33' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/23' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/35' 2024-08-31T12:18:37.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/26' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './299/37' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './299' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/19' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/15' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/20' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/12' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/10' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/11' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/16' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/14' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/18' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/13' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/166/17' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/166' 2024-08-31T12:18:37.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/19' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/15' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/20' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/12' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/10' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/11' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/16' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/14' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/18' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/13' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/147/17' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/147' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/19' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/15' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/20' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/12' 2024-08-31T12:18:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/10' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/11' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/16' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/14' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/18' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/13' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/151/17' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/151' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/19' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/15' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/20' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/12' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/10' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/11' 2024-08-31T12:18:37.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/16' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/14' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/18' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/13' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/170/17' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/170' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/19' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/15' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/20' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/12' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/10' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/11' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/16' 2024-08-31T12:18:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/14' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/18' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/13' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/167/17' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/167' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/19' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/15' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/20' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/12' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/10' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/11' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/16' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/14' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/18' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/13' 2024-08-31T12:18:37.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/140/17' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/140' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/19' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/15' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/20' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/12' 2024-08-31T12:18:37.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/10' 2024-08-31T12:18:39.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/11' 2024-08-31T12:18:39.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/16' 2024-08-31T12:18:39.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/14' 2024-08-31T12:18:39.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/18' 2024-08-31T12:18:39.452 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/13' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/142/17' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/142' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/19' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/15' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/20' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/12' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/10' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/11' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/16' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/14' 2024-08-31T12:18:39.453 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/18' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/13' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/150/17' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/150' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/19' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/15' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/20' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/12' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/10' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/11' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/16' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/14' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/18' 2024-08-31T12:18:39.454 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/13' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/105/17' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/105' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/19' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/15' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/20' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/12' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/10' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/11' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/16' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/14' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/18' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/13' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/149/17' 2024-08-31T12:18:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/149' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/19' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/15' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/20' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/12' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/10' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/11' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/16' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/14' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/18' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/13' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/109/17' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/109' 2024-08-31T12:18:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/19' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/15' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/20' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/12' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/10' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/11' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/16' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/14' 2024-08-31T12:18:39.457 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/18' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/13' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/158/17' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/158' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/19' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/15' 2024-08-31T12:18:39.460 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/20' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/12' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/10' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/11' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/16' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/14' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/18' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/13' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/106/17' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/106' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/19' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/15' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/20' 2024-08-31T12:18:39.461 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/12' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/10' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/11' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/16' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/14' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/18' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/13' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/189/17' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/189' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/19' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/15' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/20' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/12' 2024-08-31T12:18:39.462 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/10' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/11' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/16' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/14' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/18' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/13' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/133/17' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/133' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/19' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/15' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/20' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/12' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/10' 2024-08-31T12:18:39.463 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/11' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/16' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/14' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/18' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/13' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/173/17' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/173' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/19' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/15' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/20' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/12' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/10' 2024-08-31T12:18:42.223 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/11' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/16' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/14' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/18' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/13' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/174/17' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/174' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/19' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/15' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/20' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/12' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/10' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/11' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/16' 2024-08-31T12:18:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/14' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/18' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/13' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/155/17' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/155' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/19' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/15' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/20' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/12' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/10' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/11' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/16' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/14' 2024-08-31T12:18:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/18' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/13' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/114/17' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/114' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/19' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/15' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/20' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/12' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/10' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/11' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/16' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/14' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/18' 2024-08-31T12:18:42.226 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/13' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/159/17' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/159' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/19' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/15' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/20' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/12' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/10' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/11' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/16' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/14' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/18' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/13' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/187/17' 2024-08-31T12:18:42.227 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/187' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/19' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/15' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/20' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/12' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/10' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/11' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/16' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/14' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/18' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/13' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/185/17' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/185' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/19' 2024-08-31T12:18:42.228 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/15' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/20' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/12' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/10' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/11' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/16' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/14' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/18' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/13' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/120/17' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/120' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/19' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/15' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/20' 2024-08-31T12:18:42.229 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/12' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/10' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/11' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/16' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/14' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/18' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/13' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/110/17' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/110' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/19' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/15' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/20' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/12' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/10' 2024-08-31T12:18:42.230 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/11' 2024-08-31T12:18:42.231 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/16' 2024-08-31T12:18:42.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/14' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/18' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/13' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/137/17' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/137' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/19' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/15' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/20' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/12' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/10' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/11' 2024-08-31T12:18:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/16' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/14' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/18' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/13' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/198/17' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/198' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/19' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/15' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/20' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/12' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/10' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/11' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/16' 2024-08-31T12:18:42.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/14' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/18' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/13' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/136/17' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/136' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/19' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/15' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/20' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/12' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/10' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/11' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/16' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/14' 2024-08-31T12:18:42.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/18' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/13' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/125/17' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/125' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/19' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/15' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/20' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/12' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/10' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/11' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/16' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/14' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/18' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/13' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/194/17' 2024-08-31T12:18:42.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/194' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/19' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/15' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/20' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/12' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/10' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/11' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/16' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/14' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/18' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/13' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/119/17' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/119' 2024-08-31T12:18:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/19' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/15' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/20' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/12' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/10' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/11' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/16' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/14' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/18' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/13' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/157/17' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/157' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/19' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/15' 2024-08-31T12:18:42.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/20' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/12' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/10' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/11' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/16' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/14' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/18' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/13' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/172/17' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/172' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/19' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/15' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/20' 2024-08-31T12:18:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/12' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/10' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/11' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/16' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/14' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/18' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/13' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/186/17' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/186' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/19' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/15' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/20' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/12' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/10' 2024-08-31T12:18:42.743 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/11' 2024-08-31T12:18:42.744 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/16' 2024-08-31T12:18:42.744 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/14' 2024-08-31T12:18:43.734 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/18' 2024-08-31T12:18:43.734 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/13' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/190/17' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/190' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/19' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/15' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/20' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/12' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/10' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/11' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/16' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/14' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/18' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/13' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/104/17' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/104' 2024-08-31T12:18:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/19' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/15' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/20' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/12' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/10' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/11' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/16' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/14' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/18' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/13' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/164/17' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/164' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/19' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/15' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/20' 2024-08-31T12:18:43.736 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/12' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/10' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/11' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/16' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/14' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/18' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/13' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/112/17' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/112' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/19' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/15' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/20' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/12' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/10' 2024-08-31T12:18:43.737 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/11' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/16' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/14' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/18' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/13' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/100/17' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/100' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/19' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/15' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/20' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/12' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/10' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/11' 2024-08-31T12:18:43.738 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/16' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/14' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/18' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/13' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/134/17' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/134' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/19' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/15' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/20' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/12' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/10' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/11' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/16' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/14' 2024-08-31T12:18:43.739 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/18' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/13' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/115/17' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/115' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/19' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/15' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/20' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/12' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/10' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/11' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/16' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/14' 2024-08-31T12:18:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/18' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/13' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/116/17' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/116' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/19' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/15' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/20' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/12' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/10' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/11' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/16' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/14' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/18' 2024-08-31T12:18:43.741 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/13' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/195/17' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/195' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/19' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/15' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/20' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/12' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/10' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/11' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/16' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/14' 2024-08-31T12:18:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/18' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/13' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/138/17' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/138' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/19' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/15' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/20' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/12' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/10' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/11' 2024-08-31T12:18:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/16' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/14' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/18' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/13' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/135/17' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/135' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/19' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/15' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/20' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/12' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/10' 2024-08-31T12:18:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/11' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/16' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/14' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/18' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/13' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/117/17' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/117' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/19' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/15' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/20' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/12' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/10' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/11' 2024-08-31T12:18:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/16' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/14' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/18' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/13' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/143/17' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/143' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/19' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/15' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/20' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/12' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/10' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/11' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/16' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/14' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/18' 2024-08-31T12:18:45.173 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/13' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/180/17' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/180' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/19' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/15' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/20' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/12' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/10' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/11' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/16' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/14' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/18' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/13' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/126/17' 2024-08-31T12:18:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/126' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/19' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/15' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/20' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/12' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/10' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/11' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/16' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/14' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/18' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/13' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/161/17' 2024-08-31T12:18:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/161' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/19' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/15' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/20' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/12' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/10' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/11' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/16' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/14' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/18' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/13' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/176/17' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/176' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/19' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/15' 2024-08-31T12:18:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/20' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/12' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/10' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/11' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/16' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/14' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/18' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/13' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/111/17' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/111' 2024-08-31T12:18:45.177 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/19' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/15' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/20' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/12' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/10' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/11' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/16' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/14' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/18' 2024-08-31T12:18:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/13' 2024-08-31T12:18:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/191/17' 2024-08-31T12:18:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/191' 2024-08-31T12:18:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/19' 2024-08-31T12:18:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/15' 2024-08-31T12:18:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/20' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/12' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/10' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/11' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/16' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/14' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/18' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/13' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/184/17' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/184' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/19' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/15' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/20' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/12' 2024-08-31T12:18:46.492 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/10' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/11' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/16' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/14' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/18' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/13' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/192/17' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/192' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/19' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/15' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/20' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/12' 2024-08-31T12:18:46.493 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/10' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/11' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/16' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/14' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/18' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/13' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/103/17' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/103' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/19' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/15' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/20' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/12' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/10' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/11' 2024-08-31T12:18:46.494 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/16' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/14' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/18' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/13' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/128/17' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/128' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/19' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/15' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/20' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/12' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/10' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/11' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/16' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/14' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/18' 2024-08-31T12:18:46.495 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/13' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/144/17' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/144' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/19' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/15' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/20' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/12' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/10' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/11' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/16' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/14' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/18' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/13' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/146/17' 2024-08-31T12:18:46.496 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/146' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/19' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/15' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/20' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/12' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/10' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/11' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/16' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/14' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/18' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/13' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/141/17' 2024-08-31T12:18:46.497 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/141' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/19' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/15' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/20' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/12' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/10' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/11' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/16' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/14' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/18' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/13' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/182/17' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/182' 2024-08-31T12:18:46.498 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/19' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/15' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/20' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/12' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/10' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/11' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/16' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/14' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/18' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/13' 2024-08-31T12:18:46.499 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/107/17' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/107' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/19' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/15' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/20' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/12' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/10' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/11' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/16' 2024-08-31T12:18:47.055 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/14' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/18' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/13' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/178/17' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/178' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/19' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/15' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/20' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/12' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/10' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/11' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/16' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/14' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/18' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/13' 2024-08-31T12:18:47.056 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/156/17' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/156' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/19' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/15' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/20' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/12' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/10' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/11' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/16' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/14' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/18' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/13' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/131/17' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/131' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/19' 2024-08-31T12:18:47.057 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/15' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/20' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/12' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/10' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/11' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/16' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/14' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/18' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/13' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/123/17' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/123' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/19' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/15' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/20' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/12' 2024-08-31T12:18:47.058 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/10' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/11' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/16' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/14' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/18' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/13' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/160/17' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/160' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/19' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/15' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/20' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/12' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/10' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/11' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/16' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/14' 2024-08-31T12:18:47.059 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/18' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/13' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/165/17' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/165' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/19' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/15' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/20' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/12' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/10' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/11' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/16' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/14' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/18' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/13' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/101/17' 2024-08-31T12:18:47.060 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/101' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/19' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/15' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/20' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/12' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/10' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/11' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/16' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/14' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/18' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/13' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/148/17' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/148' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/19' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/15' 2024-08-31T12:18:47.061 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/20' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/12' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/10' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/11' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/16' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/14' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/18' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/13' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/168/17' 2024-08-31T12:18:47.062 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/168' 2024-08-31T12:18:49.189 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/19' 2024-08-31T12:18:49.189 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/15' 2024-08-31T12:18:49.189 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/20' 2024-08-31T12:18:49.189 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/12' 2024-08-31T12:18:49.189 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/10' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/11' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/16' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/14' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/18' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/13' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/179/17' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/179' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/19' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/15' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/20' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/12' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/10' 2024-08-31T12:18:49.190 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/11' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/16' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/14' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/18' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/13' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/132/17' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/132' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/19' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/15' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/20' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/12' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/10' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/11' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/16' 2024-08-31T12:18:49.191 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/14' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/18' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/13' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/199/17' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/199' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/19' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/15' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/20' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/12' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/10' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/11' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/16' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/14' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/18' 2024-08-31T12:18:49.192 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/13' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/163/17' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/163' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/19' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/15' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/20' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/12' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/10' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/11' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/16' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/14' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/18' 2024-08-31T12:18:49.193 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/13' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/153/17' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/153' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/19' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/15' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/20' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/12' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/10' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/11' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/16' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/14' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/18' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/13' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/122/17' 2024-08-31T12:18:49.194 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/122' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/19' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/15' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/20' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/12' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/10' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/11' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/16' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/14' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/18' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/13' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/162/17' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/162' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/19' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/15' 2024-08-31T12:18:49.195 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/20' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/12' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/10' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/11' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/16' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/14' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/18' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/13' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/197/17' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/197' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/19' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/15' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/20' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/12' 2024-08-31T12:18:49.196 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/10' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/11' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/16' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/14' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/18' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/13' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/113/17' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/113' 2024-08-31T12:18:49.197 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/19' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/15' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/20' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/12' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/10' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/11' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/16' 2024-08-31T12:18:50.761 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/14' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/18' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/13' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/152/17' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/152' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/19' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/15' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/20' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/12' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/10' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/11' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/16' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/14' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/18' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/13' 2024-08-31T12:18:50.762 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/121/17' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/121' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/19' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/15' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/20' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/12' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/10' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/11' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/16' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/14' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/18' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/13' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/118/17' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/118' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/19' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/15' 2024-08-31T12:18:50.763 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/20' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/12' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/10' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/11' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/16' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/14' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/18' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/13' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/196/17' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/196' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/19' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/15' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/20' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/12' 2024-08-31T12:18:50.764 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/10' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/11' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/16' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/14' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/18' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/13' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/124/17' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/124' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/19' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/15' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/20' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/12' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/10' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/11' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/16' 2024-08-31T12:18:50.765 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/14' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/18' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/13' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/188/17' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/188' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/19' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/15' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/20' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/12' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/10' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/11' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/16' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/14' 2024-08-31T12:18:50.766 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/18' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/13' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/145/17' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/145' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/19' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/15' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/20' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/12' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/10' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/11' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/16' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/14' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/18' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/13' 2024-08-31T12:18:50.767 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/130/17' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/130' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/19' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/15' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/20' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/12' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/10' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/11' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/16' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/14' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/18' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/13' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/193/17' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/193' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/19' 2024-08-31T12:18:50.768 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/15' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/20' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/12' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/10' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/11' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/16' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/14' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/18' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/13' 2024-08-31T12:18:52.301 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/175/17' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/175' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/19' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/15' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/20' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/12' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/10' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/11' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/16' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/14' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/18' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/13' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/181/17' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/181' 2024-08-31T12:18:52.302 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/19' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/15' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/20' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/12' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/10' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/11' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/16' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/14' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/18' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/13' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/127/17' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/127' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/19' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/15' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/20' 2024-08-31T12:18:52.303 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/12' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/10' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/11' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/16' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/14' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/18' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/13' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/108/17' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/108' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/19' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/15' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/20' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/12' 2024-08-31T12:18:52.304 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/10' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/11' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/16' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/14' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/18' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/13' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/183/17' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/183' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/19' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/15' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/20' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/12' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/10' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/11' 2024-08-31T12:18:52.305 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/16' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/14' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/18' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/13' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/177/17' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/177' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/19' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/15' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/20' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/12' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/10' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/11' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/16' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/14' 2024-08-31T12:18:52.306 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/18' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/13' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/169/17' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/169' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/19' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/15' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/20' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/12' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/10' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/11' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/16' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/14' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/18' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/13' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/154/17' 2024-08-31T12:18:52.307 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/154' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/19' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/15' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/20' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/12' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/10' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/11' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/16' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/14' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/18' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/13' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/171/17' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/171' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/19' 2024-08-31T12:18:52.308 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/15' 2024-08-31T12:18:52.309 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/20' 2024-08-31T12:18:52.557 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/12' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/10' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/11' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/16' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/14' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/18' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/13' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/139/17' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/139' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/19' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/15' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/20' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/12' 2024-08-31T12:18:52.558 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/10' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/11' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/16' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/14' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/18' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/13' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/102/17' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/102' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/19' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/15' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/20' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/12' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/10' 2024-08-31T12:18:52.559 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/11' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/16' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/14' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/18' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/13' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed './copyofsnap1/test1/129/17' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1/129' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1/test1' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:removed directory './copyofsnap1' 2024-08-31T12:18:52.560 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:18:52.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:18:52.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:18:52.592 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-08-31T12:18:52.593 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-08-31T12:18:52.650 INFO:tasks.workunit.client.0.smithi164.stderr:+ set -e 2024-08-31T12:18:52.650 INFO:tasks.workunit.client.0.smithi164.stderr:+ touch foo 2024-08-31T12:18:52.654 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod +x foo 2024-08-31T12:18:52.654 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir .snap/s 2024-08-31T12:18:52.678 INFO:tasks.workunit.client.0.smithi164.stderr:+ find .snap/s/foo -executable 2024-08-31T12:18:52.678 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep foo 2024-08-31T12:18:52.682 INFO:tasks.workunit.client.0.smithi164.stdout:.snap/s/foo 2024-08-31T12:18:52.682 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir .snap/s 2024-08-31T12:18:52.694 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm foo 2024-08-31T12:18:52.699 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:18:52.700 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:18:52.700 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:18:52.700 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:18:52.769 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-08-31T12:18:52.769 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-08-31T12:18:52.830 INFO:tasks.workunit.client.0.smithi164.stderr:+ set -e 2024-08-31T12:18:52.831 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir foo 2024-08-31T12:18:52.836 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo x 2024-08-31T12:18:52.836 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:18:57.089 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir foo/.snap/ss 2024-08-31T12:18:57.105 INFO:tasks.workunit.client.0.smithi164.stderr:+ ln foo/x foo/xx 2024-08-31T12:18:57.109 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat foo/.snap/ss/x 2024-08-31T12:18:57.122 INFO:tasks.workunit.client.0.smithi164.stdout:x 2024-08-31T12:18:57.122 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir foo/.snap/ss 2024-08-31T12:18:57.244 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo a 2024-08-31T12:18:57.247 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo b 2024-08-31T12:18:57.247 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir foo/.snap/s 2024-08-31T12:18:57.265 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat foo/.snap/s/a 2024-08-31T12:18:57.283 INFO:tasks.workunit.client.0.smithi164.stderr:+ r=a 2024-08-31T12:18:57.283 INFO:tasks.workunit.client.0.smithi164.stderr:+ [ -z a ] 2024-08-31T12:18:57.283 INFO:tasks.workunit.client.0.smithi164.stderr:+ ln foo/b foo/b2 2024-08-31T12:18:57.287 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat foo/.snap/s/b 2024-08-31T12:18:57.308 INFO:tasks.workunit.client.0.smithi164.stdout:b 2024-08-31T12:18:57.309 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo this used to hang: 2024-08-31T12:18:57.309 INFO:tasks.workunit.client.0.smithi164.stdout:this used to hang: 2024-08-31T12:18:57.309 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo more 2024-08-31T12:18:57.309 INFO:tasks.workunit.client.0.smithi164.stdout:oh, it didn't hang! good job. 2024-08-31T12:18:57.310 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo oh, it didn't hang! good job. 2024-08-31T12:18:57.310 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat foo/b 2024-08-31T12:18:57.310 INFO:tasks.workunit.client.0.smithi164.stdout:b 2024-08-31T12:18:57.310 INFO:tasks.workunit.client.0.smithi164.stdout:more 2024-08-31T12:18:57.311 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir foo/.snap/s 2024-08-31T12:18:57.322 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm -r foo 2024-08-31T12:18:57.359 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:18:57.360 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:18:57.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:18:57.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:18:57.435 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-08-31T12:18:57.436 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-08-31T12:18:57.518 INFO:tasks.workunit.client.0.smithi164.stderr:+ set -e 2024-08-31T12:18:57.518 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:57.527 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir .snap/bar 2024-08-31T12:18:57.595 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/foo 2024-08-31T12:18:57.863 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/foo 2024-08-31T12:18:57.874 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:18:57.879 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/bar/a 2024-08-31T12:18:57.884 INFO:tasks.workunit.client.0.smithi164.stdout: File: .snap/bar/a 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout:Device: feh/254d Inode: 1099511633797 Links: 2 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout:Access: 2024-08-31 12:18:57.516855663 +0000 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout:Modify: 2024-08-31 12:18:57.516855663 +0000 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout:Change: 2024-08-31 12:18:57.516855663 +0000 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stdout: Birth: 2024-08-31 12:18:57.516855663 +0000 2024-08-31T12:18:57.885 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir .snap/bar 2024-08-31T12:18:57.902 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:18:57.903 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:18:57.904 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:18:57.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:18:57.972 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-08-31T12:18:57.973 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-08-31T12:18:58.030 INFO:tasks.workunit.client.0.smithi164.stderr:+ set -e 2024-08-31T12:18:58.030 INFO:tasks.workunit.client.0.smithi164.stderr:+ seq 1 20 2024-08-31T12:18:58.031 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:58.035 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:18:58.037 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:18:58.057 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:18:58.070 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:18:58.070 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:18:58.071 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:18:58.389 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:18:58.404 INFO:tasks.workunit.client.0.smithi164.stdout: 39611 ? 00:00:00 ps 2024-08-31T12:18:58.405 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:18:58.426 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:18:58.431 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:18:58.444 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:58.447 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:18:58.450 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:18:58.469 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:18:58.480 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:18:58.480 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:18:58.481 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:18:58.522 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:18:58.536 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:18:58.537 INFO:tasks.workunit.client.0.smithi164.stdout: 39621 ? 00:00:00 ps 2024-08-31T12:18:58.538 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:18:58.656 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:18:58.660 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:18:58.674 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:58.678 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:18:58.680 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:18:58.704 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:18:58.718 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:18:58.718 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:18:58.719 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:18:59.461 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:18:59.476 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:18:59.477 INFO:tasks.workunit.client.0.smithi164.stdout: 39631 ? 00:00:00 ps 2024-08-31T12:18:59.477 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:18:59.505 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:18:59.510 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:18:59.523 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:59.527 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:18:59.529 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:18:59.548 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:18:59.560 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:18:59.560 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:18:59.561 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:18:59.741 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:18:59.755 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:18:59.756 INFO:tasks.workunit.client.0.smithi164.stdout: 39641 ? 00:00:00 ps 2024-08-31T12:18:59.757 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:18:59.852 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:18:59.859 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:18:59.876 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:18:59.878 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:18:59.880 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:18:59.888 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:18:59.894 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:18:59.895 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:18:59.896 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:00.099 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:00.115 INFO:tasks.workunit.client.0.smithi164.stdout: 39651 ? 00:00:00 ps 2024-08-31T12:19:00.116 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:00.133 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:00.136 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:00.145 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:00.148 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:00.150 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:00.161 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:00.170 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:00.170 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:00.170 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:00.214 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:00.228 INFO:tasks.workunit.client.0.smithi164.stdout: 39661 ? 00:00:00 ps 2024-08-31T12:19:00.229 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:00.253 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:00.258 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:00.271 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:00.275 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:00.277 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:00.499 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:01.002 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:01.002 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:01.003 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:01.241 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:01.255 INFO:tasks.workunit.client.0.smithi164.stdout: 39671 ? 00:00:00 ps 2024-08-31T12:19:01.256 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:01.279 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:01.284 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:01.297 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:01.302 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:01.304 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:01.323 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:01.336 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:01.336 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:01.337 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:01.424 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:01.441 INFO:tasks.workunit.client.0.smithi164.stdout: 39681 ? 00:00:00 ps 2024-08-31T12:19:01.442 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:01.454 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:01.456 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:01.463 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:01.466 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:01.467 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:01.477 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:01.483 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:01.484 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:01.485 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:01.732 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:01.746 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:01.747 INFO:tasks.workunit.client.0.smithi164.stdout: 39691 ? 00:00:00 ps 2024-08-31T12:19:01.748 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:01.772 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:01.777 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:01.791 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:01.795 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:01.797 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:01.817 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:01.830 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:01.830 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:01.831 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:01.924 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:01.938 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:01.939 INFO:tasks.workunit.client.0.smithi164.stdout: 39701 ? 00:00:00 ps 2024-08-31T12:19:01.940 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:01.962 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:01.967 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:01.980 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:01.984 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:01.986 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:02.006 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:02.018 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:02.018 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:02.019 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:02.065 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:02.080 INFO:tasks.workunit.client.0.smithi164.stdout: 39711 ? 00:00:00 ps 2024-08-31T12:19:02.082 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:02.082 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:02.105 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:02.109 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:02.123 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:02.127 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:02.130 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:02.152 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:02.164 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:02.164 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:02.165 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:02.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 -- 172.21.15.164:0/1414187744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc0c1f40 msgr2=0x7f13cc152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 --2- 172.21.15.164:0/1414187744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc0c1f40 0x7f13cc152a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009900 tx=0x7f13b801f0d0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 -- 172.21.15.164:0/1414187744 shutdown_connections 2024-08-31T12:19:02.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 --2- 172.21.15.164:0/1414187744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 0x7f13cc074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 --2- 172.21.15.164:0/1414187744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc0c1f40 0x7f13cc152a10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 -- 172.21.15.164:0/1414187744 >> 172.21.15.164:0/1414187744 conn(0x7f13cc0ccf20 msgr2=0x7f13cc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:02.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 -- 172.21.15.164:0/1414187744 shutdown_connections 2024-08-31T12:19:02.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.232+0000 7f13d3e00640 1 -- 172.21.15.164:0/1414187744 wait complete. 2024-08-31T12:19:02.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 Processor -- start 2024-08-31T12:19:02.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 -- start start 2024-08-31T12:19:02.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13cc0c1f40 0x7f13cc1e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 0x7f13cc1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0c8030 con 0x7f13cc15bc70 2024-08-31T12:19:02.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0c3150 con 0x7f13cc0c1f40 2024-08-31T12:19:02.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d3e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc074c60 con 0x7f13cc0c9330 2024-08-31T12:19:02.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.236+0000 7f13d1e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51702/0 (socket says 172.21.15.164:51702) 2024-08-31T12:19:02.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 -- 172.21.15.164:0/2992161878 learned_addr learned my addr 172.21.15.164:0/2992161878 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:02.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1400640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13cc0c1f40 0x7f13cc1e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d0a00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 0x7f13cc1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 -- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 msgr2=0x7f13cc1f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 0x7f13cc1f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 -- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13cc0c1f40 msgr2=0x7f13cc1e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13cc0c1f40 0x7f13cc1e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 -- 172.21.15.164:0/2992161878 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc1f68a0 con 0x7f13cc15bc70 2024-08-31T12:19:02.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d1e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13c400e940 tx=0x7f13c400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4004d30 con 0x7f13cc15bc70 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13c400cb20 con 0x7f13cc15bc70 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4005020 con 0x7f13cc15bc70 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc15b2d0 con 0x7f13cc15bc70 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc15a510 con 0x7f13cc15bc70 2024-08-31T12:19:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc152a10 con 0x7f13cc15bc70 2024-08-31T12:19:02.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.240+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f13c40051c0 con 0x7f13cc15bc70 2024-08-31T12:19:02.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.244+0000 7f13c9600640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 0x7f13ac0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.244+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6844+0+0 (secure 0 0 0) 0x7f13c40937c0 con 0x7f13cc15bc70 2024-08-31T12:19:02.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.244+0000 7f13d1400640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 0x7f13ac0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.244+0000 7f13d1400640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 0x7f13ac0745d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f13c0007fd0 tx=0x7f13c0009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:02.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.248+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f13cc1f68a0 con 0x7f13cc15bc70 2024-08-31T12:19:02.275 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:02.289 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:02.290 INFO:tasks.workunit.client.0.smithi164.stdout: 39745 ? 00:00:00 ps 2024-08-31T12:19:02.291 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:02.314 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:02.319 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:02.332 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:02.336 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:02.339 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:02.385 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:02.400 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:02.400 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:02.401 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:02.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13cc0c82f0 con 0x7f13cc15bc70 2024-08-31T12:19:02.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13c9600640 1 -- 172.21.15.164:0/2992161878 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f13c4016030 con 0x7f13cc15bc70 2024-08-31T12:19:02.472 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:02.473 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:02.474 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:02.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 msgr2=0x7f13ac0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 0x7f13ac0745d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f13c0007fd0 tx=0x7f13c0009040 comp rx=0 tx=0).stop 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 msgr2=0x7f13cc14f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.468+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13c400e940 tx=0x7f13c400ee00 comp rx=0 tx=0).stop 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 shutdown_connections 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ac0720c0 0x7f13ac0745d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13cc15bc70 0x7f13cc14f310 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13cc0c9330 0x7f13cc1f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 --2- 172.21.15.164:0/2992161878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13cc0c1f40 0x7f13cc1e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 >> 172.21.15.164:0/2992161878 conn(0x7f13cc0ccf20 msgr2=0x7f13cc151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:02.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 shutdown_connections 2024-08-31T12:19:02.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.472+0000 7f13d3e00640 1 -- 172.21.15.164:0/2992161878 wait complete. 2024-08-31T12:19:02.476 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:02.490 INFO:tasks.workunit.client.0.smithi164.stdout: 39757 ? 00:00:00 ps 2024-08-31T12:19:02.494 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-08-31T12:19:02.495 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-31T12:19:02.495 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:19:02.496 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:02.527 INFO:tasks.ceph.mds.d:Stopped 2024-08-31T12:19:02.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 -- 172.21.15.164:0/3575703978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f486815bc70 msgr2=0x7f4868152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 --2- 172.21.15.164:0/3575703978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f486815bc70 0x7f4868152a10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4868073280 tx=0x7f485801f0b0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 -- 172.21.15.164:0/3575703978 shutdown_connections 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 --2- 172.21.15.164:0/3575703978 >> v2:172.21.15.184:3300/0 conn(0x7f48680c9330 0x7f4868074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 --2- 172.21.15.164:0/3575703978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f486815bc70 0x7f4868152a10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 -- 172.21.15.164:0/3575703978 >> 172.21.15.164:0/3575703978 conn(0x7f48680ccf20 msgr2=0x7f48680cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 -- 172.21.15.164:0/3575703978 shutdown_connections 2024-08-31T12:19:02.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.692+0000 7f486e200640 1 -- 172.21.15.164:0/3575703978 wait complete. 2024-08-31T12:19:02.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 Processor -- start 2024-08-31T12:19:02.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 -- start start 2024-08-31T12:19:02.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 0x7f486815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 0x7f486814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48680c8030 con 0x7f48680c1f40 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48680c3150 con 0x7f486815bc70 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f486e200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4868074c60 con 0x7f48680c9330 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f4867400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f4867400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51722/0 (socket says 172.21.15.164:51722) 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.696+0000 7f4867400640 1 -- 172.21.15.164:0/78752898 learned_addr learned my addr 172.21.15.164:0/78752898 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867e00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 0x7f486814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485fe00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 0x7f486815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 -- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 msgr2=0x7f486815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 0x7f486815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 -- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 msgr2=0x7f486814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 0x7f486814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 -- 172.21.15.164:0/78752898 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486815a5e0 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867e00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 0x7f486814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485fe00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 0x7f486815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f4867400640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48580b3040 tx=0x7f4858004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48580be070 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48580053e0 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486814f3e0 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48580b5040 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48681f30f0 con 0x7f48680c1f40 2024-08-31T12:19:02.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4868074720 con 0x7f48680c1f40 2024-08-31T12:19:02.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.700+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f48580c1070 con 0x7f48680c1f40 2024-08-31T12:19:02.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.704+0000 7f485f400640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 0x7f48440745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:02.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.704+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6788+0+0 (secure 0 0 0) 0x7f485812fdc0 con 0x7f48680c1f40 2024-08-31T12:19:02.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.704+0000 7f485fe00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 0x7f48440745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:02.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.704+0000 7f485fe00640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 0x7f48440745d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f486815bc10 tx=0x7f4850009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:02.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.708+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4858018c10 con 0x7f48680c1f40 2024-08-31T12:19:02.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4868069f10 con 0x7f48680c1f40 2024-08-31T12:19:02.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f485f400640 1 -- 172.21.15.164:0/78752898 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f48580fb2d0 con 0x7f48680c1f40 2024-08-31T12:19:02.920 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:02.920 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:02.920 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 msgr2=0x7f48440745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 0x7f48440745d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f486815bc10 tx=0x7f4850009040 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 msgr2=0x7f4868155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48580b3040 tx=0x7f4858004600 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 shutdown_connections 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48440720c0 0x7f48440745d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f486815bc70 0x7f486814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48680c9330 0x7f486815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 --2- 172.21.15.164:0/78752898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48680c1f40 0x7f4868155a70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.916+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 >> 172.21.15.164:0/78752898 conn(0x7f48680ccf20 msgr2=0x7f48680765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:02.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.920+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 shutdown_connections 2024-08-31T12:19:02.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:02.920+0000 7f486e200640 1 -- 172.21.15.164:0/78752898 wait complete. 2024-08-31T12:19:02.942 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:04.942 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:05.039 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:19:05.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:19:05.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 -- 172.21.15.164:0/2262634840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152850 msgr2=0x7fda20158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:05.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 --2- 172.21.15.164:0/2262634840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152850 0x7fda20158480 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fda08009900 tx=0x7fda0801c850 comp rx=0 tx=0).stop 2024-08-31T12:19:05.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 -- 172.21.15.164:0/2262634840 shutdown_connections 2024-08-31T12:19:05.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 --2- 172.21.15.164:0/2262634840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152850 0x7fda20158480 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 -- 172.21.15.164:0/2262634840 >> 172.21.15.164:0/2262634840 conn(0x7fda200cd430 msgr2=0x7fda200cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:05.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 -- 172.21.15.164:0/2262634840 shutdown_connections 2024-08-31T12:19:05.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.104+0000 7fda26000640 1 -- 172.21.15.164:0/2262634840 wait complete. 2024-08-31T12:19:05.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 Processor -- start 2024-08-31T12:19:05.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 -- start start 2024-08-31T12:19:05.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:05.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 0x7fda20071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:05.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda201589c0 0x7fda2013ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fda200c4ab0 con 0x7fda20152440 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fda200c4930 con 0x7fda201589c0 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda26000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fda200c6cc0 con 0x7fda20152850 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda24c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda24c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51734/0 (socket says 172.21.15.164:51734) 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda24c00640 1 -- 172.21.15.164:0/4243962230 learned_addr learned my addr 172.21.15.164:0/4243962230 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda17e00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 0x7fda20071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.108+0000 7fda25600640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda201589c0 0x7fda2013ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:05.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 -- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 msgr2=0x7fda20071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 0x7fda20071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 -- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda201589c0 msgr2=0x7fda2013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda201589c0 0x7fda2013ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 -- 172.21.15.164:0/4243962230 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda200cbfa0 con 0x7fda20152440 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda17e00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 0x7fda20071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda24c00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c3f0 tx=0x7fda1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda100052d0 con 0x7fda20152440 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda10007020 con 0x7fda20152440 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda20147ff0 con 0x7fda20152440 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10007470 con 0x7fda20152440 2024-08-31T12:19:05.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda201475d0 con 0x7fda20152440 2024-08-31T12:19:05.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda201477a0 con 0x7fda20152440 2024-08-31T12:19:05.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fda100067e0 con 0x7fda20152440 2024-08-31T12:19:05.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 0x7fd9fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:05.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.112+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6788+0+0 (secure 0 0 0) 0x7fda100925a0 con 0x7fda20152440 2024-08-31T12:19:05.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.116+0000 7fda17e00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 0x7fd9fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:05.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.116+0000 7fda17e00640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 0x7fd9fc0745d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda080af000 tx=0x7fda0801b090 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:05.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.116+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fda1005d980 con 0x7fda20152440 2024-08-31T12:19:05.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda200c59e0 con 0x7fda20152440 2024-08-31T12:19:05.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda1d600640 1 -- 172.21.15.164:0/4243962230 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7fda10001090 con 0x7fda20152440 2024-08-31T12:19:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:05.320 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:05.320 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 msgr2=0x7fd9fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 0x7fd9fc0745d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda080af000 tx=0x7fda0801b090 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 msgr2=0x7fda20147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c3f0 tx=0x7fda1000c8b0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 shutdown_connections 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd9fc0720c0 0x7fd9fc0745d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda201589c0 0x7fda2013ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda20152850 0x7fda20071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 --2- 172.21.15.164:0/4243962230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda20152440 0x7fda20147ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.316+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 >> 172.21.15.164:0/4243962230 conn(0x7fda200cd430 msgr2=0x7fda2014c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.320+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 shutdown_connections 2024-08-31T12:19:05.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:05.320+0000 7fda26000640 1 -- 172.21.15.164:0/4243962230 wait complete. 2024-08-31T12:19:05.342 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:07.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:07.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 -- 172.21.15.164:0/365794379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 msgr2=0x7f713c0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:07.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 --2- 172.21.15.164:0/365794379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c0c8d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7124009900 tx=0x7f712401f0d0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 -- 172.21.15.164:0/365794379 shutdown_connections 2024-08-31T12:19:07.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 --2- 172.21.15.164:0/365794379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c0c8d70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 --2- 172.21.15.164:0/365794379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 0x7f713c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 -- 172.21.15.164:0/365794379 >> 172.21.15.164:0/365794379 conn(0x7f713c0ccf20 msgr2=0x7f713c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:07.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 -- 172.21.15.164:0/365794379 shutdown_connections 2024-08-31T12:19:07.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.504+0000 7f7141c00640 1 -- 172.21.15.164:0/365794379 wait complete. 2024-08-31T12:19:07.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 Processor -- start 2024-08-31T12:19:07.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- start start 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f713c074e20 0x7f713c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 0x7f713c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1599b0 con 0x7f713c156e10 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f713c069fc0 con 0x7f713c074e20 2024-08-31T12:19:07.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f713c159c90 con 0x7f713c0c92b0 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52944/0 (socket says 172.21.15.164:52944) 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 -- 172.21.15.164:0/2341222004 learned_addr learned my addr 172.21.15.164:0/2341222004 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713aa00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f713c074e20 0x7f713c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7132000640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 0x7f713c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 -- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 msgr2=0x7f713c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 0x7f713c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 -- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f713c074e20 msgr2=0x7f713c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f713c074e20 0x7f713c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 -- 172.21.15.164:0/2341222004 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c15c480 con 0x7f713c156e10 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f713b400640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f713400e970 tx=0x7f713400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134004d30 con 0x7f713c156e10 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f713400cb20 con 0x7f713c156e10 2024-08-31T12:19:07.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c15ad40 con 0x7f713c156e10 2024-08-31T12:19:07.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134005020 con 0x7f713c156e10 2024-08-31T12:19:07.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.508+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c15b2e0 con 0x7f713c156e10 2024-08-31T12:19:07.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.512+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f713c0b19c0 con 0x7f713c156e10 2024-08-31T12:19:07.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.512+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f71340051c0 con 0x7f713c156e10 2024-08-31T12:19:07.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.512+0000 7f7133400640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 0x7f7118074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:07.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.512+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6788+0+0 (secure 0 0 0) 0x7f71340938e0 con 0x7f713c156e10 2024-08-31T12:19:07.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.512+0000 7f713aa00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 0x7f7118074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:07.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.516+0000 7f713aa00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 0x7f7118074600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f712c007fd0 tx=0x7f712c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:07.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.520+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7134016030 con 0x7f713c156e10 2024-08-31T12:19:07.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.720+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f713c15b9a0 con 0x7f713c156e10 2024-08-31T12:19:07.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.720+0000 7f7133400640 1 -- 172.21.15.164:0/2341222004 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f713c15b9a0 con 0x7f713c156e10 2024-08-31T12:19:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:07.724 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:07.725 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 msgr2=0x7f7118074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 0x7f7118074600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f712c007fd0 tx=0x7f712c009040 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 msgr2=0x7f713c15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f713400e970 tx=0x7f713400ee30 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 shutdown_connections 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71180720f0 0x7f7118074600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f713c156e10 0x7f713c15bf40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f713c0c92b0 0x7f713c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 --2- 172.21.15.164:0/2341222004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f713c074e20 0x7f713c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 >> 172.21.15.164:0/2341222004 conn(0x7f713c0ccf20 msgr2=0x7f713c157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 shutdown_connections 2024-08-31T12:19:07.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:07.724+0000 7f7141c00640 1 -- 172.21.15.164:0/2341222004 wait complete. 2024-08-31T12:19:07.746 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:09.748 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 -- 172.21.15.164:0/538805141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c155e80 msgr2=0x7f643c0c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 --2- 172.21.15.164:0/538805141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c155e80 0x7f643c0c5980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f643c06fc60 tx=0x7f642c01c830 comp rx=0 tx=0).stop 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 -- 172.21.15.164:0/538805141 shutdown_connections 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 --2- 172.21.15.164:0/538805141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c06e720 0x7f643c0cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 --2- 172.21.15.164:0/538805141 >> v2:172.21.15.184:3300/0 conn(0x7f643c0c97e0 0x7f643c06e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:09.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 --2- 172.21.15.164:0/538805141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c155e80 0x7f643c0c5980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:09.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.908+0000 7f6440a00640 1 -- 172.21.15.164:0/538805141 >> 172.21.15.164:0/538805141 conn(0x7f643c071be0 msgr2=0x7f643c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:09.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- 172.21.15.164:0/538805141 shutdown_connections 2024-08-31T12:19:09.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- 172.21.15.164:0/538805141 wait complete. 2024-08-31T12:19:09.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 Processor -- start 2024-08-31T12:19:09.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- start start 2024-08-31T12:19:09.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c0c97e0 0x7f643c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 0x7f643c154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f643c15c430 con 0x7f643c06e720 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0c5260 con 0x7f643c155e80 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6440a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f643c15c5b0 con 0x7f643c0c97e0 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.912+0000 7f6439e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52954/0 (socket says 172.21.15.164:52954) 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 -- 172.21.15.164:0/314331348 learned_addr learned my addr 172.21.15.164:0/314331348 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439400640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c0c97e0 0x7f643c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f643a800640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 0x7f643c154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 -- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c0c97e0 msgr2=0x7f643c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:09.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c0c97e0 0x7f643c14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 -- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 msgr2=0x7f643c154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 0x7f643c154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 -- 172.21.15.164:0/314331348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c14d660 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f643a800640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 0x7f643c154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6439e00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f642c01aee0 tx=0x7f642c0a6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0bd070 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f642c004430 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c1f8f50 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c005290 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c15ece0 con 0x7f643c06e720 2024-08-31T12:19:09.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.916+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c0cedf0 con 0x7f643c06e720 2024-08-31T12:19:09.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.920+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f642c0c0070 con 0x7f643c06e720 2024-08-31T12:19:09.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.920+0000 7f6432000640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 0x7f641c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:09.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.920+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6788+0+0 (secure 0 0 0) 0x7f642c12d1b0 con 0x7f643c06e720 2024-08-31T12:19:09.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.920+0000 7f6439400640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 0x7f641c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:09.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.920+0000 7f6439400640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 0x7f641c0745d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f64280058d0 tx=0x7f6428005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:09.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:09.924+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f642c0164b0 con 0x7f643c06e720 2024-08-31T12:19:10.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.120+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643c0c9290 con 0x7f643c06e720 2024-08-31T12:19:10.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6432000640 1 -- 172.21.15.164:0/314331348 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f642c0f8730 con 0x7f643c06e720 2024-08-31T12:19:10.126 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:10.127 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:10.127 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:10.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 msgr2=0x7f641c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:10.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 0x7f641c0745d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f64280058d0 tx=0x7f6428005860 comp rx=0 tx=0).stop 2024-08-31T12:19:10.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 msgr2=0x7f643c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f642c01aee0 tx=0x7f642c0a6730 comp rx=0 tx=0).stop 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 shutdown_connections 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f641c0720c0 0x7f641c0745d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f643c155e80 0x7f643c154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f643c0c97e0 0x7f643c14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 --2- 172.21.15.164:0/314331348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f643c06e720 0x7f643c0c7620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 >> 172.21.15.164:0/314331348 conn(0x7f643c071be0 msgr2=0x7f643c073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 shutdown_connections 2024-08-31T12:19:10.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:10.124+0000 7f6440a00640 1 -- 172.21.15.164:0/314331348 wait complete. 2024-08-31T12:19:10.148 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:12.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:12.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- 172.21.15.164:0/1170117418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700156e10 msgr2=0x7f57000c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 --2- 172.21.15.164:0/1170117418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700156e10 0x7f57000c8d70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009900 tx=0x7f56e801f0d0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- 172.21.15.164:0/1170117418 shutdown_connections 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 --2- 172.21.15.164:0/1170117418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700156e10 0x7f57000c8d70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 --2- 172.21.15.164:0/1170117418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- 172.21.15.164:0/1170117418 >> 172.21.15.164:0/1170117418 conn(0x7f57000ccf20 msgr2=0x7f57000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- 172.21.15.164:0/1170117418 shutdown_connections 2024-08-31T12:19:12.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- 172.21.15.164:0/1170117418 wait complete. 2024-08-31T12:19:12.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 Processor -- start 2024-08-31T12:19:12.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.312+0000 7f5706e00640 1 -- start start 2024-08-31T12:19:12.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:12.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5700156e10 0x7f57000736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f57001599b0 con 0x7f5700074e20 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5700069fc0 con 0x7f5700156e10 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5700159c90 con 0x7f57000c92b0 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52968/0 (socket says 172.21.15.164:52968) 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 -- 172.21.15.164:0/740179896 learned_addr learned my addr 172.21.15.164:0/740179896 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56f7400640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5704e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5700156e10 0x7f57000736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 -- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 msgr2=0x7f5700151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 -- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5700156e10 msgr2=0x7f57000736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5700156e10 0x7f57000736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 -- 172.21.15.164:0/740179896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57001514f0 con 0x7f5700074e20 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56f7400640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56ffe00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c780 tx=0x7f56f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0017070 con 0x7f5700074e20 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56f0005070 con 0x7f5700074e20 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57000c28c0 con 0x7f5700074e20 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0005480 con 0x7f5700074e20 2024-08-31T12:19:12.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5700152910 con 0x7f5700074e20 2024-08-31T12:19:12.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.316+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5700159f70 con 0x7f5700074e20 2024-08-31T12:19:12.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.320+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f56f001a070 con 0x7f5700074e20 2024-08-31T12:19:12.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.320+0000 7f56fcc00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 0x7f56dc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:12.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.320+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6788+0+0 (secure 0 0 0) 0x7f56f0092730 con 0x7f5700074e20 2024-08-31T12:19:12.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.320+0000 7f56f7400640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 0x7f56dc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:12.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.320+0000 7f56f7400640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 0x7f56dc074600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f56e80b2000 tx=0x7f56e801d910 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:12.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.324+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f56f005db50 con 0x7f5700074e20 2024-08-31T12:19:12.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.520+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5700074c00 con 0x7f5700074e20 2024-08-31T12:19:12.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f56fcc00640 1 -- 172.21.15.164:0/740179896 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f56f0066090 con 0x7f5700074e20 2024-08-31T12:19:12.527 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:12.527 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:12.527 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 msgr2=0x7f56dc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 0x7f56dc074600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f56e80b2000 tx=0x7f56e801d910 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 msgr2=0x7f57000cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c780 tx=0x7f56f000cc40 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 shutdown_connections 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f56dc0720f0 0x7f56dc074600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5700156e10 0x7f57000736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57000c92b0 0x7f5700151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 --2- 172.21.15.164:0/740179896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5700074e20 0x7f57000cb3c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:12.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 >> 172.21.15.164:0/740179896 conn(0x7f57000ccf20 msgr2=0x7f570015cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:12.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 shutdown_connections 2024-08-31T12:19:12.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:12.524+0000 7f5706e00640 1 -- 172.21.15.164:0/740179896 wait complete. 2024-08-31T12:19:12.548 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:14.549 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:14.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 -- 172.21.15.164:0/883674834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5870005260 msgr2=0x7f587000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:14.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 --2- 172.21.15.164:0/883674834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5870005260 0x7f587000b9d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f58840016f0 tx=0x7f588401c7b0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 -- 172.21.15.164:0/883674834 shutdown_connections 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 --2- 172.21.15.164:0/883674834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5870005260 0x7f587000b9d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 -- 172.21.15.164:0/883674834 >> 172.21.15.164:0/883674834 conn(0x7f588c0ccf20 msgr2=0x7f588c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 -- 172.21.15.164:0/883674834 shutdown_connections 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.716+0000 7f5891800640 1 -- 172.21.15.164:0/883674834 wait complete. 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 Processor -- start 2024-08-31T12:19:14.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- start start 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5870005260 0x7f588c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f588c153510 0x7f588c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f588c1599b0 con 0x7f588c0af9a0 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f588c15a2e0 con 0x7f5870005260 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f588c159c90 con 0x7f588c153510 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:14.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52986/0 (socket says 172.21.15.164:52986) 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 -- 172.21.15.164:0/2323014658 learned_addr learned my addr 172.21.15.164:0/2323014658 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588aa00640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5870005260 0x7f588c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5882000640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f588c153510 0x7f588c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 -- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f588c153510 msgr2=0x7f588c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f588c153510 0x7f588c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 -- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5870005260 msgr2=0x7f588c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5870005260 0x7f588c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 -- 172.21.15.164:0/2323014658 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588c0b13b0 con 0x7f588c0af9a0 2024-08-31T12:19:14.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f588b400640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f588401cc90 tx=0x7f58840a6be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884001310 con 0x7f588c0af9a0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58840b5020 con 0x7f588c0af9a0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588c1f1bd0 con 0x7f588c0af9a0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884006930 con 0x7f588c0af9a0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588c153fd0 con 0x7f588c0af9a0 2024-08-31T12:19:14.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.720+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588c157220 con 0x7f588c0af9a0 2024-08-31T12:19:14.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.724+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5884003810 con 0x7f588c0af9a0 2024-08-31T12:19:14.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.724+0000 7f5883400640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 0x7f5868074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:14.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.724+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6788+0+0 (secure 0 0 0) 0x7f588412cc90 con 0x7f588c0af9a0 2024-08-31T12:19:14.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.724+0000 7f588aa00640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 0x7f5868074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:14.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.724+0000 7f588aa00640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 0x7f5868074600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f587c002240 tx=0x7f587c006040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:14.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.728+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f58840c0060 con 0x7f588c0af9a0 2024-08-31T12:19:14.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.928+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f588c0aeb00 con 0x7f588c0af9a0 2024-08-31T12:19:14.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.928+0000 7f5883400640 1 -- 172.21.15.164:0/2323014658 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f5884016510 con 0x7f588c0af9a0 2024-08-31T12:19:14.933 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:14.934 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 msgr2=0x7f5868074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 0x7f5868074600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f587c002240 tx=0x7f587c006040 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 msgr2=0x7f588c0afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f588401cc90 tx=0x7f58840a6be0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 shutdown_connections 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f58680720f0 0x7f5868074600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f588c0af9a0 0x7f588c0afdb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f588c153510 0x7f588c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 --2- 172.21.15.164:0/2323014658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5870005260 0x7f588c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 >> 172.21.15.164:0/2323014658 conn(0x7f588c0ccf20 msgr2=0x7f588c1581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:14.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 shutdown_connections 2024-08-31T12:19:14.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:14.932+0000 7f5891800640 1 -- 172.21.15.164:0/2323014658 wait complete. 2024-08-31T12:19:14.955 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:16.956 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.116+0000 7fa7abe00640 1 -- 172.21.15.164:0/4050091351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40c9bf0 msgr2=0x7fa7a4153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.116+0000 7fa7abe00640 1 --2- 172.21.15.164:0/4050091351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a4153890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa790009900 tx=0x7fa79001c8e0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.116+0000 7fa7abe00640 1 -- 172.21.15.164:0/4050091351 shutdown_connections 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.116+0000 7fa7abe00640 1 --2- 172.21.15.164:0/4050091351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a40cde50 0x7fa7a40ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.116+0000 7fa7abe00640 1 --2- 172.21.15.164:0/4050091351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a4153890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- 172.21.15.164:0/4050091351 >> 172.21.15.164:0/4050091351 conn(0x7fa7a4070c00 msgr2=0x7fa7a4074740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:17.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- 172.21.15.164:0/4050091351 shutdown_connections 2024-08-31T12:19:17.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- 172.21.15.164:0/4050091351 wait complete. 2024-08-31T12:19:17.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 Processor -- start 2024-08-31T12:19:17.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- start start 2024-08-31T12:19:17.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a41f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:17.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a415cdf0 0x7fa7a40c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40c8ad0 con 0x7fa7a40cde50 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a406db80 con 0x7fa7a40c9bf0 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.120+0000 7fa7abe00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a41669f0 con 0x7fa7a415cdf0 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36968/0 (socket says 172.21.15.164:36968) 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 -- 172.21.15.164:0/746640606 learned_addr learned my addr 172.21.15.164:0/746640606 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a9e00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a415cdf0 0x7fa7a40c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a9400640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a41f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 -- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a415cdf0 msgr2=0x7fa7a40c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a415cdf0 0x7fa7a40c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 -- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7a40c9bf0 msgr2=0x7fa7a41f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a41f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 -- 172.21.15.164:0/746640606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a41f8ef0 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a8a00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b0040 tx=0x7fa7900a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b2040 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7900043b0 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a4163200 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790005290 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a40c4c80 con 0x7fa7a40cde50 2024-08-31T12:19:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a4153890 con 0x7fa7a40cde50 2024-08-31T12:19:17.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.124+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa7900be060 con 0x7fa7a40cde50 2024-08-31T12:19:17.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.128+0000 7fa7a1600640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 0x7fa784074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.128+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6732+0+0 (secure 0 0 0) 0x7fa79012c3d0 con 0x7fa7a40cde50 2024-08-31T12:19:17.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.128+0000 7fa7a9400640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 0x7fa784074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:17.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.128+0000 7fa7a9400640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 0x7fa784074600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa798001650 tx=0x7fa798009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:17.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.132+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa7900164d0 con 0x7fa7a40cde50 2024-08-31T12:19:17.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.328+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7a414c880 con 0x7fa7a40cde50 2024-08-31T12:19:17.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.328+0000 7fa7a1600640 1 -- 172.21.15.164:0/746640606 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7fa7900f7800 con 0x7fa7a40cde50 2024-08-31T12:19:17.333 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:17.333 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:17.334 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 msgr2=0x7fa784074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 0x7fa784074600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa798001650 tx=0x7fa798009040 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 msgr2=0x7fa7a40cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b0040 tx=0x7fa7900a5730 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 shutdown_connections 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa7840720f0 0x7fa784074600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7a415cdf0 0x7fa7a40c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7a40cde50 0x7fa7a40cb180 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 --2- 172.21.15.164:0/746640606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7a40c9bf0 0x7fa7a41f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 >> 172.21.15.164:0/746640606 conn(0x7fa7a4070c00 msgr2=0x7fa7a4076a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 shutdown_connections 2024-08-31T12:19:17.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:17.332+0000 7fa7abe00640 1 -- 172.21.15.164:0/746640606 wait complete. 2024-08-31T12:19:17.356 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:19.356 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- 172.21.15.164:0/1258572727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c1526d0 msgr2=0x7f292c0c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- 172.21.15.164:0/1258572727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c1526d0 0x7f292c0c2ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f291c009bc0 tx=0x7f291c01cba0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- 172.21.15.164:0/1258572727 shutdown_connections 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- 172.21.15.164:0/1258572727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 0x7f292c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- 172.21.15.164:0/1258572727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c1526d0 0x7f292c0c2ee0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- 172.21.15.164:0/1258572727 >> 172.21.15.164:0/1258572727 conn(0x7f292c06dd40 msgr2=0x7f292c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:19.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- 172.21.15.164:0/1258572727 shutdown_connections 2024-08-31T12:19:19.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- 172.21.15.164:0/1258572727 wait complete. 2024-08-31T12:19:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 Processor -- start 2024-08-31T12:19:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- start start 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 0x7f292c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c1526d0 0x7f292c143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f292c0704a0 con 0x7f292c0c3420 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f292c0c88c0 con 0x7f292c1526d0 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.520+0000 7f2932200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f292c0c8170 con 0x7f292c071520 2024-08-31T12:19:19.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36982/0 (socket says 172.21.15.164:36982) 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 -- 172.21.15.164:0/4021570316 learned_addr learned my addr 172.21.15.164:0/4021570316 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292b400640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 0x7f292c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292be00640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c1526d0 0x7f292c143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 -- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 msgr2=0x7f292c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 0x7f292c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 -- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c1526d0 msgr2=0x7f292c143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c1526d0 0x7f292c143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 -- 172.21.15.164:0/4021570316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c144a90 con 0x7f292c0c3420 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f292aa00640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f291800c410 tx=0x7f291800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918011790 con 0x7f292c0c3420 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2918017070 con 0x7f292c0c3420 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918011ce0 con 0x7f292c0c3420 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c1412f0 con 0x7f292c0c3420 2024-08-31T12:19:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1468e0 con 0x7f292c0c3420 2024-08-31T12:19:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c0c2ee0 con 0x7f292c0c3420 2024-08-31T12:19:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.524+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f291801c460 con 0x7f292c0c3420 2024-08-31T12:19:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.528+0000 7f2923400640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 0x7f290c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:19.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.528+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6732+0+0 (secure 0 0 0) 0x7f2918092d50 con 0x7f292c0c3420 2024-08-31T12:19:19.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.528+0000 7f292b400640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 0x7f290c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:19.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.528+0000 7f292b400640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 0x7f290c074600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f291c0af000 tx=0x7f291c01b3e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:19.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.532+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f291805e200 con 0x7f292c0c3420 2024-08-31T12:19:19.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.732+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f292c0c7d40 con 0x7f292c0c3420 2024-08-31T12:19:19.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.732+0000 7f2923400640 1 -- 172.21.15.164:0/4021570316 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6889 (secure 0 0 0) 0x7f291805db00 con 0x7f292c0c3420 2024-08-31T12:19:19.736 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:19.736 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":16,"btime":"2024-08-31T12:17:05:831016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:16:57.679707+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":53,"addr":"172.21.15.184:6837/1093030453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1093030453},{"type":"v1","addr":"172.21.15.184:6837","nonce":1093030453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4384,"qdb_cluster":[4384]},"id":1}]} 2024-08-31T12:19:19.736 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 16 2024-08-31T12:19:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 msgr2=0x7f290c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 0x7f290c074600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f291c0af000 tx=0x7f291c01b3e0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 msgr2=0x7f292c140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f291800c410 tx=0x7f291800c8d0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 shutdown_connections 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f290c0720f0 0x7f290c074600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c1526d0 0x7f292c143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f292c0c3420 0x7f292c140db0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 --2- 172.21.15.164:0/4021570316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c071520 0x7f292c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 >> 172.21.15.164:0/4021570316 conn(0x7f292c06dd40 msgr2=0x7f292c157620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 shutdown_connections 2024-08-31T12:19:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:19.736+0000 7f2932200640 1 -- 172.21.15.164:0/4021570316 wait complete. 2024-08-31T12:19:19.759 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:19:21.760 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 -- 172.21.15.164:0/497924627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c0c9330 msgr2=0x7f602c074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 --2- 172.21.15.164:0/497924627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c0c9330 0x7f602c074720 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6024009900 tx=0x7f602401f0d0 comp rx=0 tx=0).stop 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 -- 172.21.15.164:0/497924627 shutdown_connections 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 --2- 172.21.15.164:0/497924627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c0c9330 0x7f602c074720 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 --2- 172.21.15.164:0/497924627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c1f40 0x7f602c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 -- 172.21.15.164:0/497924627 >> 172.21.15.164:0/497924627 conn(0x7f602c0ccf20 msgr2=0x7f602c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 -- 172.21.15.164:0/497924627 shutdown_connections 2024-08-31T12:19:21.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 -- 172.21.15.164:0/497924627 wait complete. 2024-08-31T12:19:21.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.920+0000 7f6032000640 1 Processor -- start 2024-08-31T12:19:21.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- start start 2024-08-31T12:19:21.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f602c0c1f40 0x7f602c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:21.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 0x7f602c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0c8030 con 0x7f602c15bc70 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0c3150 con 0x7f602c0c1f40 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f602c074c60 con 0x7f602c0c9330 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36998/0 (socket says 172.21.15.164:36998) 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 -- 172.21.15.164:0/1459311371 learned_addr learned my addr 172.21.15.164:0/1459311371 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602aa00640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 0x7f602c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602b400640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f602c0c1f40 0x7f602c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 -- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 msgr2=0x7f602c0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 0x7f602c0c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 -- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f602c0c1f40 msgr2=0x7f602c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f602c0c1f40 0x7f602c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:21.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 -- 172.21.15.164:0/1459311371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c0c6c20 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602aa00640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 0x7f602c0c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f602be00640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f602401d780 tx=0x7f6024005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60240b5040 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6024005320 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c14ac70 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60240046d0 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c0c6400 con 0x7f602c15bc70 2024-08-31T12:19:21.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.924+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c152a10 con 0x7f602c15bc70 2024-08-31T12:19:21.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.928+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f60240c0060 con 0x7f602c15bc70 2024-08-31T12:19:21.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.928+0000 7f6023400640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 0x7f600c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:21.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.928+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f602412fb60 con 0x7f602c15bc70 2024-08-31T12:19:21.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.928+0000 7f602b400640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 0x7f600c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:21.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.928+0000 7f602b400640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 0x7f600c074600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f601c0012f0 tx=0x7f601c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:21.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:21.932+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f602c14ac70 con 0x7f602c15bc70 2024-08-31T12:19:22.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f602c1560a0 con 0x7f602c15bc70 2024-08-31T12:19:22.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6023400640 1 -- 172.21.15.164:0/1459311371 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f6024018c30 con 0x7f602c15bc70 2024-08-31T12:19:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:22.135 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":17,"btime":"2024-08-31T12:19:21:344095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:21.344089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:22.135 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 17 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 msgr2=0x7f600c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 0x7f600c074600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f601c0012f0 tx=0x7f601c009040 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 msgr2=0x7f602c0cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f602401d780 tx=0x7f6024005df0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 shutdown_connections 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f600c0720f0 0x7f600c074600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c15bc70 0x7f602c0cc070 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f602c0c9330 0x7f602c0c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 --2- 172.21.15.164:0/1459311371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f602c0c1f40 0x7f602c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 >> 172.21.15.164:0/1459311371 conn(0x7f602c0ccf20 msgr2=0x7f602c149fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:22.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 shutdown_connections 2024-08-31T12:19:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.132+0000 7f6032000640 1 -- 172.21.15.164:0/1459311371 wait complete. 2024-08-31T12:19:22.157 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-08-31T12:19:22.157 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-08-31T12:19:22.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 -- 172.21.15.164:0/73738758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81d0005260 msgr2=0x7f81d000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 --2- 172.21.15.164:0/73738758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81d0005260 0x7f81d000b9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c610 tx=0x7f81e401d2c0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 -- 172.21.15.164:0/73738758 shutdown_connections 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 --2- 172.21.15.164:0/73738758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81d0005260 0x7f81d000b9d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 -- 172.21.15.164:0/73738758 >> 172.21.15.164:0/73738758 conn(0x7f81ec0ccf20 msgr2=0x7f81ec0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 -- 172.21.15.164:0/73738758 shutdown_connections 2024-08-31T12:19:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.308+0000 7f81f0c00640 1 -- 172.21.15.164:0/73738758 wait complete. 2024-08-31T12:19:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 Processor -- start 2024-08-31T12:19:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- start start 2024-08-31T12:19:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d0005260 0x7f81ec1f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81ec0b2d20 0x7f81ec155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1599b0 con 0x7f81ec151e10 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec15a2e0 con 0x7f81d0005260 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec159c90 con 0x7f81ec0b2d20 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37010/0 (socket says 172.21.15.164:37010) 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 -- 172.21.15.164:0/373624355 learned_addr learned my addr 172.21.15.164:0/373624355 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81e1400640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81ec0b2d20 0x7f81ec155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81e9e00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d0005260 0x7f81ec1f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 -- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81ec0b2d20 msgr2=0x7f81ec155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81ec0b2d20 0x7f81ec155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 -- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d0005260 msgr2=0x7f81ec1f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d0005260 0x7f81ec1f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 -- 172.21.15.164:0/373624355 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec1f2500 con 0x7f81ec151e10 2024-08-31T12:19:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81ea800640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f81e4000f90 tx=0x7f81e400c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003d90 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81e4006070 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec156210 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40064a0 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.312+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec0cc8c0 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec14fb90 con 0x7f81ec151e10 2024-08-31T12:19:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f81e4006640 con 0x7f81ec151e10 2024-08-31T12:19:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81e2a00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 0x7f81c80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f81e412d290 con 0x7f81ec151e10 2024-08-31T12:19:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81e9e00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 0x7f81c80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.316+0000 7f81e9e00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 0x7f81c80745d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c10 tx=0x7f81dc006a50 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.320+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f81e4017070 con 0x7f81ec151e10 2024-08-31T12:19:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81ec157220 con 0x7f81ec151e10 2024-08-31T12:19:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81e2a00640 1 -- 172.21.15.164:0/373624355 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f81e40f8830 con 0x7f81ec151e10 2024-08-31T12:19:22.520 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:22.520 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":17,"btime":"2024-08-31T12:19:21:344095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:21.344089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 17 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 msgr2=0x7f81c80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 0x7f81c80745d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c10 tx=0x7f81dc006a50 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 msgr2=0x7f81ec14ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f81e4000f90 tx=0x7f81e400c2e0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 shutdown_connections 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f81c80720c0 0x7f81c80745d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81ec151e10 0x7f81ec14ee60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81ec0b2d20 0x7f81ec155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 --2- 172.21.15.164:0/373624355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d0005260 0x7f81ec1f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.516+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 >> 172.21.15.164:0/373624355 conn(0x7f81ec0ccf20 msgr2=0x7f81ec1576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.520+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 shutdown_connections 2024-08-31T12:19:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:22.520+0000 7f81f0c00640 1 -- 172.21.15.164:0/373624355 wait complete. 2024-08-31T12:19:22.542 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:19:21:344095+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4992": { "addr": "172.21.15.164:6835/580774116", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6834", "nonce": 580774116, "type": "v2" }, { "addr": "172.21.15.164:6835", "nonce": 580774116, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4992, "incarnation": 17, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 52, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:19:21.344089+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4992 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:19:24.543 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:24.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 -- 172.21.15.164:0/2051286301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 msgr2=0x7f9e4c163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:24.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 --2- 172.21.15.164:0/2051286301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c163760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400ad90 tx=0x7f9e4401d9f0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 -- 172.21.15.164:0/2051286301 shutdown_connections 2024-08-31T12:19:24.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 --2- 172.21.15.164:0/2051286301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c163760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 -- 172.21.15.164:0/2051286301 >> 172.21.15.164:0/2051286301 conn(0x7f9e4c0ccf20 msgr2=0x7f9e4c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:24.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 -- 172.21.15.164:0/2051286301 shutdown_connections 2024-08-31T12:19:24.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.704+0000 7f9e51600640 1 -- 172.21.15.164:0/2051286301 wait complete. 2024-08-31T12:19:24.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 Processor -- start 2024-08-31T12:19:24.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 -- start start 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e4c0b2900 0x7f9e4c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e4c0b2fe0 0x7f9e4c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c158980 con 0x7f9e4c1520f0 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c158800 con 0x7f9e4c0b2900 2024-08-31T12:19:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e51600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c0c8f20 con 0x7f9e4c0b2fe0 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37036/0 (socket says 172.21.15.164:37036) 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 -- 172.21.15.164:0/1724189708 learned_addr learned my addr 172.21.15.164:0/1724189708 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4aa00640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e4c0b2900 0x7f9e4c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e42000640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e4c0b2fe0 0x7f9e4c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 -- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e4c0b2fe0 msgr2=0x7f9e4c0c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e4c0b2fe0 0x7f9e4c0c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 -- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e4c0b2900 msgr2=0x7f9e4c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e4c0b2900 0x7f9e4c14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 -- 172.21.15.164:0/1724189708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c0c7290 con 0x7f9e4c1520f0 2024-08-31T12:19:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.708+0000 7f9e4b400640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e440993f0 tx=0x7f9e440a6750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440be070 con 0x7f9e4c1520f0 2024-08-31T12:19:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e44003db0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c1f71d0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440b3040 con 0x7f9e4c1520f0 2024-08-31T12:19:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c1f6ef0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4c0c8420 con 0x7f9e4c1520f0 2024-08-31T12:19:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9e440c1070 con 0x7f9e4c1520f0 2024-08-31T12:19:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 0x7f9e280745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:24.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f9e4412d5d0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.712+0000 7f9e4aa00640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 0x7f9e280745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:24.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.716+0000 7f9e4aa00640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 0x7f9e280745d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c000f70 tx=0x7f9e3c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:24.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.716+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9e440178a0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.916+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e4c1557f0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e43400640 1 -- 172.21.15.164:0/1724189708 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f9e440f89e0 con 0x7f9e4c1520f0 2024-08-31T12:19:24.922 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:24.922 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":17,"btime":"2024-08-31T12:19:21:344095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:21.344089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:24.923 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 17 2024-08-31T12:19:24.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 msgr2=0x7f9e280745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 0x7f9e280745d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c000f70 tx=0x7f9e3c009040 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 msgr2=0x7f9e4c1f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e440993f0 tx=0x7f9e440a6750 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 shutdown_connections 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9e280720c0 0x7f9e280745d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e4c1520f0 0x7f9e4c1f6330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e4c0b2fe0 0x7f9e4c0c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 --2- 172.21.15.164:0/1724189708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e4c0b2900 0x7f9e4c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 >> 172.21.15.164:0/1724189708 conn(0x7f9e4c0ccf20 msgr2=0x7f9e4c156990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 shutdown_connections 2024-08-31T12:19:24.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:24.920+0000 7f9e51600640 1 -- 172.21.15.164:0/1724189708 wait complete. 2024-08-31T12:19:24.944 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:26.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- 172.21.15.164:0/246040506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e2415bc70 msgr2=0x7f3e24152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- 172.21.15.164:0/246040506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e2415bc70 0x7f3e24152a10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3e24070b70 tx=0x7f3e1401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- 172.21.15.164:0/246040506 shutdown_connections 2024-08-31T12:19:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- 172.21.15.164:0/246040506 >> v2:172.21.15.184:3300/0 conn(0x7f3e240c1f40 0x7f3e240c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- 172.21.15.164:0/246040506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e2415bc70 0x7f3e24152a10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- 172.21.15.164:0/246040506 >> 172.21.15.164:0/246040506 conn(0x7f3e240ccf20 msgr2=0x7f3e240cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- 172.21.15.164:0/246040506 shutdown_connections 2024-08-31T12:19:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- 172.21.15.164:0/246040506 wait complete. 2024-08-31T12:19:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 Processor -- start 2024-08-31T12:19:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- start start 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e240c1f40 0x7f3e24155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e2415bc70 0x7f3e240c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24074fb0 con 0x7f3e240c7920 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24074e30 con 0x7f3e240c1f40 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.108+0000 7f3e2b400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240c7d30 con 0x7f3e2415bc70 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51460/0 (socket says 172.21.15.164:51460) 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 -- 172.21.15.164:0/4071028302 learned_addr learned my addr 172.21.15.164:0/4071028302 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e28a00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e240c1f40 0x7f3e24155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:27.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e29400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e2415bc70 0x7f3e240c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:27.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 -- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e2415bc70 msgr2=0x7f3e240c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:27.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e2415bc70 0x7f3e240c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 -- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e240c1f40 msgr2=0x7f3e24155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e240c1f40 0x7f3e24155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 -- 172.21.15.164:0/4071028302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e240ae8d0 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e1be00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d750 tx=0x7f3e0c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c017070 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0c009d20 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e240aeb70 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c005280 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e24154fc0 con 0x7f3e240c7920 2024-08-31T12:19:27.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e240c9330 con 0x7f3e240c7920 2024-08-31T12:19:27.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.112+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3e0c005420 con 0x7f3e240c7920 2024-08-31T12:19:27.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.116+0000 7f3e21600640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 0x7f3e000745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:27.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.116+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f3e0c093130 con 0x7f3e240c7920 2024-08-31T12:19:27.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.116+0000 7f3e28a00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 0x7f3e000745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:27.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.116+0000 7f3e28a00640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 0x7f3e000745d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e140b2000 tx=0x7f3e140aa040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:27.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.124+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3e0c00de60 con 0x7f3e240c7920 2024-08-31T12:19:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.376+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e241560a0 con 0x7f3e240c7920 2024-08-31T12:19:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.376+0000 7f3e21600640 1 -- 172.21.15.164:0/4071028302 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f3e0c05df70 con 0x7f3e240c7920 2024-08-31T12:19:27.380 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:27.380 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":17,"btime":"2024-08-31T12:19:21:344095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:21.344089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 17 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 msgr2=0x7f3e000745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 0x7f3e000745d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e140b2000 tx=0x7f3e140aa040 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 msgr2=0x7f3e240afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d750 tx=0x7f3e0c00dc10 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 shutdown_connections 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e000720c0 0x7f3e000745d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e2415bc70 0x7f3e240c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e240c7920 0x7f3e240afb40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 --2- 172.21.15.164:0/4071028302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e240c1f40 0x7f3e24155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:27.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 >> 172.21.15.164:0/4071028302 conn(0x7f3e240ccf20 msgr2=0x7f3e24151110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:27.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 shutdown_connections 2024-08-31T12:19:27.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:27.380+0000 7f3e2b400640 1 -- 172.21.15.164:0/4071028302 wait complete. 2024-08-31T12:19:27.413 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:29.414 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 -- 172.21.15.164:0/1439720120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c15bc70 msgr2=0x7faa3c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 --2- 172.21.15.164:0/1439720120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c15bc70 0x7faa3c152a10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa3c070b70 tx=0x7faa2c01f0b0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 -- 172.21.15.164:0/1439720120 shutdown_connections 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 --2- 172.21.15.164:0/1439720120 >> v2:172.21.15.184:3300/0 conn(0x7faa3c0c1f40 0x7faa3c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 --2- 172.21.15.164:0/1439720120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c15bc70 0x7faa3c152a10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 -- 172.21.15.164:0/1439720120 >> 172.21.15.164:0/1439720120 conn(0x7faa3c0ccf20 msgr2=0x7faa3c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 -- 172.21.15.164:0/1439720120 shutdown_connections 2024-08-31T12:19:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 -- 172.21.15.164:0/1439720120 wait complete. 2024-08-31T12:19:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.576+0000 7faa42400640 1 Processor -- start 2024-08-31T12:19:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- start start 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 0x7faa3c1f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa3c15bc70 0x7faa3c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c074fb0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c074e30 con 0x7faa3c0c7920 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c0c7d30 con 0x7faa3c15bc70 2024-08-31T12:19:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51474/0 (socket says 172.21.15.164:51474) 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 -- 172.21.15.164:0/1357341219 learned_addr learned my addr 172.21.15.164:0/1357341219 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa32a00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 0x7faa3c1f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3be00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa3c15bc70 0x7faa3c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 -- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa3c15bc70 msgr2=0x7faa3c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa3c15bc70 0x7faa3c156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 -- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 msgr2=0x7faa3c1f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 0x7faa3c1f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 -- 172.21.15.164:0/1357341219 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c14e150 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa32a00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 0x7faa3c1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa3b400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa2c01d760 tx=0x7faa2c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0b5040 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa2c005320 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c1f42e0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0046d0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c14cf50 con 0x7faa3c0c1f40 2024-08-31T12:19:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.580+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c0c9330 con 0x7faa3c0c1f40 2024-08-31T12:19:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.584+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7faa2c0c1060 con 0x7faa3c0c1f40 2024-08-31T12:19:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.584+0000 7faa33e00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 0x7faa18074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.584+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7faa2c12fbd0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.584+0000 7faa32a00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 0x7faa18074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.584+0000 7faa32a00640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 0x7faa18074600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa24005fd0 tx=0x7faa24005f20 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:29.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.588+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7faa2c018c10 con 0x7faa3c0c1f40 2024-08-31T12:19:29.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.792+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa3c1560a0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.792+0000 7faa33e00640 1 -- 172.21.15.164:0/1357341219 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6057 (secure 0 0 0) 0x7faa2c0fb0f0 con 0x7faa3c0c1f40 2024-08-31T12:19:29.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:29.796 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":18,"btime":"2024-08-31T12:19:28:753459+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:28.706507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:reconnect","state_seq":37,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:29.797 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 18 2024-08-31T12:19:29.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 msgr2=0x7faa18074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:29.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 0x7faa18074600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa24005fd0 tx=0x7faa24005f20 comp rx=0 tx=0).stop 2024-08-31T12:19:29.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 msgr2=0x7faa3c14dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:29.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa2c01d760 tx=0x7faa2c005780 comp rx=0 tx=0).stop 2024-08-31T12:19:29.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 shutdown_connections 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faa180720f0 0x7faa18074600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa3c15bc70 0x7faa3c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa3c0c7920 0x7faa3c1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 --2- 172.21.15.164:0/1357341219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa3c0c1f40 0x7faa3c14dc10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 >> 172.21.15.164:0/1357341219 conn(0x7faa3c0ccf20 msgr2=0x7faa3c071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 shutdown_connections 2024-08-31T12:19:29.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:29.796+0000 7faa42400640 1 -- 172.21.15.164:0/1357341219 wait complete. 2024-08-31T12:19:29.818 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:31.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 -- 172.21.15.164:0/2071727045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764003a10 msgr2=0x7f1764003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 --2- 172.21.15.164:0/2071727045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764003a10 0x7f1764003e80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f177000c290 tx=0x7f177001f790 comp rx=0 tx=0).stop 2024-08-31T12:19:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f177f400640 1 -- 172.21.15.164:0/2071727045 reap_dead start 2024-08-31T12:19:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 -- 172.21.15.164:0/2071727045 shutdown_connections 2024-08-31T12:19:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 -- 172.21.15.164:0/2071727045 >> 172.21.15.164:0/2071727045 conn(0x7f17800ccf20 msgr2=0x7f17800cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 -- 172.21.15.164:0/2071727045 shutdown_connections 2024-08-31T12:19:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.980+0000 7f1785600640 1 -- 172.21.15.164:0/2071727045 wait complete. 2024-08-31T12:19:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 Processor -- start 2024-08-31T12:19:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- start start 2024-08-31T12:19:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 0x7f1780155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1780147930 0x7f1780147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f17800c8030 con 0x7f17801f0cc0 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f17800c3150 con 0x7f1764003a10 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1780152a10 con 0x7f1780147930 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51492/0 (socket says 172.21.15.164:51492) 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 -- 172.21.15.164:0/515661003 learned_addr learned my addr 172.21.15.164:0/515661003 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f177ea00640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 0x7f1780155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f177f400640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1780147930 0x7f1780147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 -- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1780147930 msgr2=0x7f1780147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1780147930 0x7f1780147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 -- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 msgr2=0x7f1780155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 0x7f1780155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 -- 172.21.15.164:0/515661003 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780151e20 con 0x7f17801f0cc0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f177ea00640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 0x7f1780155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1776000640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1768011750 tx=0x7f1768011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768004460 con 0x7f17801f0cc0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1768016070 con 0x7f17801f0cc0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17801554f0 con 0x7f17801f0cc0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176800fb80 con 0x7f17801f0cc0 2024-08-31T12:19:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.984+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17800ccbc0 con 0x7f17801f0cc0 2024-08-31T12:19:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.988+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17800c7920 con 0x7f17801f0cc0 2024-08-31T12:19:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.988+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f1768018030 con 0x7f17801f0cc0 2024-08-31T12:19:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.988+0000 7f1777400640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 0x7f175c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.988+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f1768093950 con 0x7f17801f0cc0 2024-08-31T12:19:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.988+0000 7f177ea00640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 0x7f175c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.992+0000 7f177ea00640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 0x7f175c0745d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17700b0000 tx=0x7f177001c5d0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:31.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:31.992+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f176805ede0 con 0x7f17801f0cc0 2024-08-31T12:19:32.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.192+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17801560a0 con 0x7f17801f0cc0 2024-08-31T12:19:32.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.192+0000 7f1777400640 1 -- 172.21.15.164:0/515661003 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6057 (secure 0 0 0) 0x7f176805e6e0 con 0x7f17801f0cc0 2024-08-31T12:19:32.197 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:32.198 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":18,"btime":"2024-08-31T12:19:28:753459+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:28.706507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:reconnect","state_seq":37,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:32.198 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 18 2024-08-31T12:19:32.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 msgr2=0x7f175c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:32.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 0x7f175c0745d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17700b0000 tx=0x7f177001c5d0 comp rx=0 tx=0).stop 2024-08-31T12:19:32.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 msgr2=0x7f17800cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1768011750 tx=0x7f1768011c10 comp rx=0 tx=0).stop 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 shutdown_connections 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f175c0720c0 0x7f175c0745d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1780147930 0x7f1780147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17801f0cc0 0x7f17800cc170 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 --2- 172.21.15.164:0/515661003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1764003a10 0x7f1780155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 >> 172.21.15.164:0/515661003 conn(0x7f17800ccf20 msgr2=0x7f178014ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 shutdown_connections 2024-08-31T12:19:32.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:32.196+0000 7f1785600640 1 -- 172.21.15.164:0/515661003 wait complete. 2024-08-31T12:19:32.219 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:34.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:34.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- 172.21.15.164:0/600078709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 msgr2=0x7f8b04074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:34.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 --2- 172.21.15.164:0/600078709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04074720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009c80 tx=0x7f8afc01f5a0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- 172.21.15.164:0/600078709 shutdown_connections 2024-08-31T12:19:34.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 --2- 172.21.15.164:0/600078709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04074720 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 --2- 172.21.15.164:0/600078709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b0415bc70 0x7f8b04152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- 172.21.15.164:0/600078709 >> 172.21.15.164:0/600078709 conn(0x7f8b040ccf20 msgr2=0x7f8b040cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:34.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- 172.21.15.164:0/600078709 shutdown_connections 2024-08-31T12:19:34.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- 172.21.15.164:0/600078709 wait complete. 2024-08-31T12:19:34.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 Processor -- start 2024-08-31T12:19:34.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.376+0000 7f8b09600640 1 -- start start 2024-08-31T12:19:34.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 0x7f8b040afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:34.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:34.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b0415bc70 0x7f8b04151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:34.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040c8030 con 0x7f8b040c9330 2024-08-31T12:19:34.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040c3150 con 0x7f8b0415bc70 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8b04074c60 con 0x7f8b040c1f40 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b03400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b0415bc70 0x7f8b04151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51508/0 (socket says 172.21.15.164:51508) 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 -- 172.21.15.164:0/1503821307 learned_addr learned my addr 172.21.15.164:0/1503821307 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02a00640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 0x7f8b040afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 -- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 msgr2=0x7f8b040afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 0x7f8b040afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 -- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b0415bc70 msgr2=0x7f8b04151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b0415bc70 0x7f8b04151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 -- 172.21.15.164:0/1503821307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b040b07f0 con 0x7f8b040c9330 2024-08-31T12:19:34.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02a00640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 0x7f8b040afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:19:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b02000640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c390 tx=0x7f8af000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0017070 con 0x7f8b040c9330 2024-08-31T12:19:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8af00053c0 con 0x7f8b040c9330 2024-08-31T12:19:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0415b5c0 con 0x7f8b040c9330 2024-08-31T12:19:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003840 con 0x7f8b040c9330 2024-08-31T12:19:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b040b0ed0 con 0x7f8b040c9330 2024-08-31T12:19:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.380+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b04074720 con 0x7f8b040c9330 2024-08-31T12:19:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.384+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8af001a070 con 0x7f8b040c9330 2024-08-31T12:19:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.384+0000 7f8afaa00640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.384+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f8af0092040 con 0x7f8b040c9330 2024-08-31T12:19:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.384+0000 7f8b02a00640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.384+0000 7f8b02a00640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8af400bbd0 tx=0x7f8af400b5b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:34.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.388+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8af005cf90 con 0x7f8b040c9330 2024-08-31T12:19:34.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.584+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b041560a0 con 0x7f8b040c9330 2024-08-31T12:19:34.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8afaa00640 1 -- 172.21.15.164:0/1503821307 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6054 (secure 0 0 0) 0x7f8af0061750 con 0x7f8b040c9330 2024-08-31T12:19:34.590 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:34.590 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":19,"btime":"2024-08-31T12:19:34:262632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:33.764151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:34.591 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 19 2024-08-31T12:19:34.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 msgr2=0x7f8ae4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:34.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8af400bbd0 tx=0x7f8af400b5b0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 msgr2=0x7f8b04158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c390 tx=0x7f8af000c850 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 shutdown_connections 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8ae40720f0 0x7f8ae4074600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b0415bc70 0x7f8b04151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b040c9330 0x7f8b04158c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 --2- 172.21.15.164:0/1503821307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b040c1f40 0x7f8b040afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 >> 172.21.15.164:0/1503821307 conn(0x7f8b040ccf20 msgr2=0x7f8b04070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 shutdown_connections 2024-08-31T12:19:34.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:34.588+0000 7f8b09600640 1 -- 172.21.15.164:0/1503821307 wait complete. 2024-08-31T12:19:34.612 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:19:34:262632+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 19, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4992": { "addr": "172.21.15.164:6835/580774116", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6834", "nonce": 580774116, "type": "v2" }, { "addr": "172.21.15.164:6835", "nonce": 580774116, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4992, "incarnation": 17, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 39 } }, "last_failure": 0, "last_failure_osd_epoch": 52, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:19:33.764151+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4992 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:19:35.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:19:35.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:19:36.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 -- 172.21.15.164:0/2915180863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f398015bc70 msgr2=0x7f3980152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 --2- 172.21.15.164:0/2915180863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f398015bc70 0x7f3980152a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3970009c80 tx=0x7f397001f5a0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 -- 172.21.15.164:0/2915180863 shutdown_connections 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 --2- 172.21.15.164:0/2915180863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c9330 0x7f3980074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 --2- 172.21.15.164:0/2915180863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f398015bc70 0x7f3980152a10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 -- 172.21.15.164:0/2915180863 >> 172.21.15.164:0/2915180863 conn(0x7f39800ccf20 msgr2=0x7f39800cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 -- 172.21.15.164:0/2915180863 shutdown_connections 2024-08-31T12:19:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.776+0000 7f3985400640 1 -- 172.21.15.164:0/2915180863 wait complete. 2024-08-31T12:19:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 Processor -- start 2024-08-31T12:19:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- start start 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39800c1f40 0x7f3980156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f398015bc70 0x7f3980156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39800c8030 con 0x7f39800c9330 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39800c3150 con 0x7f39800c1f40 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3980074c60 con 0x7f398015bc70 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36156/0 (socket says 172.21.15.164:36156) 2024-08-31T12:19:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 -- 172.21.15.164:0/4178626936 learned_addr learned my addr 172.21.15.164:0/4178626936 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397e800640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39800c1f40 0x7f3980156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397f200640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f398015bc70 0x7f3980156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 -- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f398015bc70 msgr2=0x7f3980156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f398015bc70 0x7f3980156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 -- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39800c1f40 msgr2=0x7f3980156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39800c1f40 0x7f3980156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 -- 172.21.15.164:0/4178626936 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980152c90 con 0x7f39800c9330 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f397de00640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c3c0 tx=0x7f396c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c017070 con 0x7f39800c9330 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f396c0053c0 con 0x7f39800c9330 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c003860 con 0x7f39800c9330 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39800cc390 con 0x7f39800c9330 2024-08-31T12:19:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.780+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39800cb5d0 con 0x7f39800c9330 2024-08-31T12:19:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.784+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3980074720 con 0x7f39800c9330 2024-08-31T12:19:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.784+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f396c01a070 con 0x7f39800c9330 2024-08-31T12:19:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.784+0000 7f3976a00640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 0x7f3960074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.784+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f396c0921b0 con 0x7f39800c9330 2024-08-31T12:19:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.784+0000 7f397e800640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 0x7f3960074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:36.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.788+0000 7f397e800640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 0x7f3960074600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39700b3000 tx=0x7f397001dde0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:36.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.792+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f396c05d080 con 0x7f39800c9330 2024-08-31T12:19:36.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.988+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39801560a0 con 0x7f39800c9330 2024-08-31T12:19:36.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.988+0000 7f3976a00640 1 -- 172.21.15.164:0/4178626936 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6054 (secure 0 0 0) 0x7f396c061840 con 0x7f39800c9330 2024-08-31T12:19:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":19,"btime":"2024-08-31T12:19:34:262632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:33.764151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:36.994 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 19 2024-08-31T12:19:36.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 msgr2=0x7f3960074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 0x7f3960074600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39700b3000 tx=0x7f397001dde0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 msgr2=0x7f398014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c3c0 tx=0x7f396c00c880 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 shutdown_connections 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39600720f0 0x7f3960074600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f398015bc70 0x7f3980156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39800c9330 0x7f398014e8e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 --2- 172.21.15.164:0/4178626936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39800c1f40 0x7f3980156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 >> 172.21.15.164:0/4178626936 conn(0x7f39800ccf20 msgr2=0x7f3980071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 shutdown_connections 2024-08-31T12:19:36.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:36.992+0000 7f3985400640 1 -- 172.21.15.164:0/4178626936 wait complete. 2024-08-31T12:19:37.016 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:39.017 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:39.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- 172.21.15.164:0/965284698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 msgr2=0x7fe548163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:39.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 --2- 172.21.15.164:0/965284698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe548163760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe540009bc0 tx=0x7fe54001cba0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- 172.21.15.164:0/965284698 shutdown_connections 2024-08-31T12:19:39.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 --2- 172.21.15.164:0/965284698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe548163760 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- 172.21.15.164:0/965284698 >> 172.21.15.164:0/965284698 conn(0x7fe5480ccf20 msgr2=0x7fe5480cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:39.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- 172.21.15.164:0/965284698 shutdown_connections 2024-08-31T12:19:39.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- 172.21.15.164:0/965284698 wait complete. 2024-08-31T12:19:39.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 Processor -- start 2024-08-31T12:19:39.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.180+0000 7fe54f600640 1 -- start start 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5480b2900 0x7fe5480b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5480b2fe0 0x7fe5480aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480c27d0 con 0x7fe5481520f0 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480c2650 con 0x7fe5480b2fe0 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe548158800 con 0x7fe5480b2900 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:39.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36182/0 (socket says 172.21.15.164:36182) 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 -- 172.21.15.164:0/3096193490 learned_addr learned my addr 172.21.15.164:0/3096193490 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe547e00640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5480b2fe0 0x7fe5480aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54cc00640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5480b2900 0x7fe5480b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 -- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5480b2900 msgr2=0x7fe5480b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5480b2900 0x7fe5480b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 -- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5480b2fe0 msgr2=0x7fe5480aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5480b2fe0 0x7fe5480aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 -- 172.21.15.164:0/3096193490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5480b0780 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54d600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe5400197b0 tx=0x7fe5400a59d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400bb070 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe540004d40 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400b2040 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5480af520 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481f8d20 con 0x7fe5481520f0 2024-08-31T12:19:39.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.184+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5480c1f40 con 0x7fe5481520f0 2024-08-31T12:19:39.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.188+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe5400be070 con 0x7fe5481520f0 2024-08-31T12:19:39.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.188+0000 7fe544c00640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 0x7fe5280745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:39.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.188+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7fe54012cf10 con 0x7fe5481520f0 2024-08-31T12:19:39.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.188+0000 7fe54cc00640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 0x7fe5280745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:39.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.188+0000 7fe54cc00640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 0x7fe5280745d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f70 tx=0x7fe538009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:39.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.192+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe540016790 con 0x7fe5481520f0 2024-08-31T12:19:39.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe548156970 con 0x7fe5481520f0 2024-08-31T12:19:39.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe544c00640 1 -- 172.21.15.164:0/3096193490 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6054 (secure 0 0 0) 0x7fe5400f83a0 con 0x7fe5481520f0 2024-08-31T12:19:39.418 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:39.419 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":19,"btime":"2024-08-31T12:19:34:262632+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:33.764151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:19:39.419 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 19 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 msgr2=0x7fe5280745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 0x7fe5280745d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f70 tx=0x7fe538009040 comp rx=0 tx=0).stop 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 msgr2=0x7fe5480aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe5400197b0 tx=0x7fe5400a59d0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 shutdown_connections 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5280720c0 0x7fe5280745d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5481520f0 0x7fe5480aefe0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5480b2fe0 0x7fe5480aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 --2- 172.21.15.164:0/3096193490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5480b2900 0x7fe5480b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:39.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 >> 172.21.15.164:0/3096193490 conn(0x7fe5480ccf20 msgr2=0x7fe54814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:39.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 shutdown_connections 2024-08-31T12:19:39.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:39.416+0000 7fe54f600640 1 -- 172.21.15.164:0/3096193490 wait complete. 2024-08-31T12:19:39.440 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:19:41.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:41.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 -- 172.21.15.164:0/2260980730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c004d50 msgr2=0x7f3d0c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 --2- 172.21.15.164:0/2260980730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c004d50 0x7f3d0c005160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3d280cadf0 tx=0x7f3d2001cb80 comp rx=0 tx=0).stop 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d27400640 1 -- 172.21.15.164:0/2260980730 reap_dead start 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 -- 172.21.15.164:0/2260980730 shutdown_connections 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 -- 172.21.15.164:0/2260980730 >> 172.21.15.164:0/2260980730 conn(0x7f3d280ccf20 msgr2=0x7f3d280cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 -- 172.21.15.164:0/2260980730 shutdown_connections 2024-08-31T12:19:41.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.604+0000 7f3d2d800640 1 -- 172.21.15.164:0/2260980730 wait complete. 2024-08-31T12:19:41.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 Processor -- start 2024-08-31T12:19:41.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- start start 2024-08-31T12:19:41.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d0c004d50 0x7f3d280c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:41.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d2814b840 0x7f3d2814bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d280c8030 con 0x7f3d281f6680 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3d280c3150 con 0x7f3d0c004d50 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3d28074e30 con 0x7f3d2814b840 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36206/0 (socket says 172.21.15.164:36206) 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 -- 172.21.15.164:0/1363392310 learned_addr learned my addr 172.21.15.164:0/1363392310 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26a00640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d0c004d50 0x7f3d280c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d27400640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d2814b840 0x7f3d2814bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 -- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d2814b840 msgr2=0x7f3d2814bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d2814b840 0x7f3d2814bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 -- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d0c004d50 msgr2=0x7f3d280c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:41.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d0c004d50 0x7f3d280c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 -- 172.21.15.164:0/1363392310 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d280b1530 con 0x7f3d281f6680 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d26000640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d140117e0 tx=0x7f3d14011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14004460 con 0x7f3d281f6680 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d14016070 con 0x7f3d281f6680 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281f5ba0 con 0x7f3d281f6680 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400fb40 con 0x7f3d281f6680 2024-08-31T12:19:41.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.608+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281f6160 con 0x7f3d281f6680 2024-08-31T12:19:41.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2815b9f0 con 0x7f3d281f6680 2024-08-31T12:19:41.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3d14018030 con 0x7f3d281f6680 2024-08-31T12:19:41.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d1ea00640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 0x7f3d080745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:41.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f3d14093620 con 0x7f3d281f6680 2024-08-31T12:19:41.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d26a00640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 0x7f3d080745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:41.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.612+0000 7f3d26a00640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 0x7f3d080745d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3d18001250 tx=0x7f3d18001120 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:41.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.616+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3d1405e470 con 0x7f3d281f6680 2024-08-31T12:19:41.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.812+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d280c26e0 con 0x7f3d281f6680 2024-08-31T12:19:41.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d1ea00640 1 -- 172.21.15.164:0/1363392310 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6061 (secure 0 0 0) 0x7f3d14062c30 con 0x7f3d281f6680 2024-08-31T12:19:41.818 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:41.818 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":20,"btime":"2024-08-31T12:19:39:811145+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:19:41.819 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 20 2024-08-31T12:19:41.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 msgr2=0x7f3d080745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:41.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 0x7f3d080745d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3d18001250 tx=0x7f3d18001120 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 msgr2=0x7f3d280b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d140117e0 tx=0x7f3d14011ca0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 shutdown_connections 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3d080720c0 0x7f3d080745d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d2814b840 0x7f3d2814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d281f6680 0x7f3d280b0630 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 --2- 172.21.15.164:0/1363392310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d0c004d50 0x7f3d280c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 >> 172.21.15.164:0/1363392310 conn(0x7f3d280ccf20 msgr2=0x7f3d28070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 shutdown_connections 2024-08-31T12:19:41.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:41.816+0000 7f3d2d800640 1 -- 172.21.15.164:0/1363392310 wait complete. 2024-08-31T12:19:41.841 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=0, replacing gid=4384 2024-08-31T12:19:41.841 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 7 secs before reviving mds.d 2024-08-31T12:19:44.919 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:44.929 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:44.937 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:44.940 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:44.941 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:44.955 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:44.965 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:44.965 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:44.966 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:45.309 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:45.323 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:45.323 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:45.323 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:45.324 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:45.324 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:45.324 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:45.324 INFO:tasks.workunit.client.0.smithi164.stdout: 40255 ? 00:00:00 ps 2024-08-31T12:19:45.324 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:45.343 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:45.346 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:45.354 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:45.357 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:45.358 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:45.372 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:45.383 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:45.383 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:45.383 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:45.474 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:45.488 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stdout: 40265 ? 00:00:00 ps 2024-08-31T12:19:45.489 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:45.508 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:45.510 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:45.518 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:45.521 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:45.522 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:45.537 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:45.547 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:45.547 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:45.548 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:45.599 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:45.612 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:45.612 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:45.612 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:45.613 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:45.613 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:45.613 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:45.613 INFO:tasks.workunit.client.0.smithi164.stdout: 40275 ? 00:00:00 ps 2024-08-31T12:19:45.613 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:45.633 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:45.636 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:45.847 INFO:tasks.ceph.mds.a.smithi164.stderr:2024-08-31T12:19:45.844+0000 7f6b31400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:19:45.897 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:45.899 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:45.900 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:45.917 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:45.927 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:45.927 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:45.928 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:46.159 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:46.172 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:46.172 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:46.172 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:46.173 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:46.173 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:46.173 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:46.173 INFO:tasks.workunit.client.0.smithi164.stdout: 40285 ? 00:00:00 ps 2024-08-31T12:19:46.173 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:46.192 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:46.194 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:46.202 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:46.205 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:46.206 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:46.221 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:46.232 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:46.232 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:46.233 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:46.290 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:46.304 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:46.304 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stdout: 40295 ? 00:00:00 ps 2024-08-31T12:19:46.305 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:46.324 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:46.326 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:46.334 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:46.337 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:46.338 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:46.353 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:46.363 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:46.364 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:46.364 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:46.425 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:46.439 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:46.439 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stdout: 40305 ? 00:00:00 ps 2024-08-31T12:19:46.440 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:46.461 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:46.464 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:46.473 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a 2024-08-31T12:19:46.477 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/one 2024-08-31T12:19:46.478 INFO:tasks.workunit.client.0.smithi164.stderr:+ cat 2024-08-31T12:19:46.493 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir a/.snap/two 2024-08-31T12:19:46.503 INFO:tasks.workunit.client.0.smithi164.stderr:+ wait 2024-08-31T12:19:46.503 INFO:tasks.workunit.client.0.smithi164.stderr:+ chmod 777 a/foo 2024-08-31T12:19:46.504 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-08-31T12:19:46.550 INFO:tasks.workunit.client.0.smithi164.stderr:+ ps 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: PID TTY TIME CMD 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: 1317 ? 00:00:00 systemd 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: 1318 ? 00:00:00 (sd-pam) 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: 18407 ? 00:00:01 sshd 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: 39600 ? 00:00:00 timeout 2024-08-31T12:19:46.564 INFO:tasks.workunit.client.0.smithi164.stdout: 39603 ? 00:00:00 snaptest-double 2024-08-31T12:19:46.565 INFO:tasks.workunit.client.0.smithi164.stdout: 40315 ? 00:00:00 ps 2024-08-31T12:19:46.565 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T12:19:46.582 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm a/foo 2024-08-31T12:19:46.585 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir a 2024-08-31T12:19:46.593 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:19:46.594 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:19:46.594 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:19:46.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:19:46.621 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-08-31T12:19:46.622 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-08-31T12:19:46.681 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir .snap/foo 2024-08-31T12:19:46.694 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo We want ENOENT, not ESTALE, here. 2024-08-31T12:19:46.694 INFO:tasks.workunit.client.0.smithi164.stdout:We want ENOENT, not ESTALE, here. 2024-08-31T12:19:46.695 INFO:tasks.workunit.client.0.smithi164.stderr:+ seq 1 100 2024-08-31T12:19:46.696 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/1 2024-08-31T12:19:46.696 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.698 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-08-31T12:19:46.699 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/2 2024-08-31T12:19:46.699 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.701 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-08-31T12:19:46.702 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/3 2024-08-31T12:19:46.702 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.703 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-08-31T12:19:46.704 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/4 2024-08-31T12:19:46.704 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.705 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-08-31T12:19:46.706 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/5 2024-08-31T12:19:46.706 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.708 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-08-31T12:19:46.709 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/6 2024-08-31T12:19:46.709 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.710 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-08-31T12:19:46.711 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/7 2024-08-31T12:19:46.711 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.712 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-08-31T12:19:46.713 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/8 2024-08-31T12:19:46.714 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.715 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-08-31T12:19:46.715 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/9 2024-08-31T12:19:46.716 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.717 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-08-31T12:19:46.718 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/10 2024-08-31T12:19:46.718 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.719 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-08-31T12:19:46.720 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/11 2024-08-31T12:19:46.720 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.722 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-08-31T12:19:46.722 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/12 2024-08-31T12:19:46.723 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.724 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-08-31T12:19:46.725 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/13 2024-08-31T12:19:46.725 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.726 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-08-31T12:19:46.727 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/14 2024-08-31T12:19:46.727 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.728 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-08-31T12:19:46.729 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/15 2024-08-31T12:19:46.729 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.731 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-08-31T12:19:46.731 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/16 2024-08-31T12:19:46.732 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.733 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-08-31T12:19:46.734 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/17 2024-08-31T12:19:46.734 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.735 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-08-31T12:19:46.736 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/18 2024-08-31T12:19:46.736 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.737 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-08-31T12:19:46.738 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/19 2024-08-31T12:19:46.738 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.739 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-08-31T12:19:46.740 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/20 2024-08-31T12:19:46.741 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.742 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-08-31T12:19:46.743 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/21 2024-08-31T12:19:46.743 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.744 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-08-31T12:19:46.745 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/22 2024-08-31T12:19:46.745 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.747 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-08-31T12:19:46.747 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/23 2024-08-31T12:19:46.748 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.749 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-08-31T12:19:46.750 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/24 2024-08-31T12:19:46.750 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.752 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-08-31T12:19:46.753 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/25 2024-08-31T12:19:46.753 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.754 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-08-31T12:19:46.755 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/26 2024-08-31T12:19:46.755 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.757 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-08-31T12:19:46.757 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/27 2024-08-31T12:19:46.757 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.759 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-08-31T12:19:46.760 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/28 2024-08-31T12:19:46.760 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.761 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-08-31T12:19:46.762 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/29 2024-08-31T12:19:46.762 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.763 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-08-31T12:19:46.764 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/30 2024-08-31T12:19:46.764 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.766 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-08-31T12:19:46.767 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/31 2024-08-31T12:19:46.767 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.768 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-08-31T12:19:46.769 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/32 2024-08-31T12:19:46.769 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.770 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-08-31T12:19:46.771 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/33 2024-08-31T12:19:46.771 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:46.773 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-08-31T12:19:46.774 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/34 2024-08-31T12:19:46.774 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.280 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-08-31T12:19:47.281 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/35 2024-08-31T12:19:47.281 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.283 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-08-31T12:19:47.284 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/36 2024-08-31T12:19:47.284 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.285 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-08-31T12:19:47.286 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/37 2024-08-31T12:19:47.286 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.288 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-08-31T12:19:47.288 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/38 2024-08-31T12:19:47.289 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.290 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-08-31T12:19:47.291 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/39 2024-08-31T12:19:47.291 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.292 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-08-31T12:19:47.293 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/40 2024-08-31T12:19:47.293 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.294 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-08-31T12:19:47.295 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/41 2024-08-31T12:19:47.295 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.297 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-08-31T12:19:47.298 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/42 2024-08-31T12:19:47.298 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.299 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-08-31T12:19:47.300 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/43 2024-08-31T12:19:47.300 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.301 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-08-31T12:19:47.302 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/44 2024-08-31T12:19:47.303 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.304 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-08-31T12:19:47.304 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/45 2024-08-31T12:19:47.305 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.306 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-08-31T12:19:47.307 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/46 2024-08-31T12:19:47.307 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.308 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-08-31T12:19:47.309 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/47 2024-08-31T12:19:47.309 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.311 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-08-31T12:19:47.312 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/48 2024-08-31T12:19:47.312 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.313 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-08-31T12:19:47.314 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/49 2024-08-31T12:19:47.314 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.316 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-08-31T12:19:47.316 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/50 2024-08-31T12:19:47.316 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.318 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-08-31T12:19:47.319 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/51 2024-08-31T12:19:47.319 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.320 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-08-31T12:19:47.321 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/52 2024-08-31T12:19:47.321 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.322 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-08-31T12:19:47.323 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/53 2024-08-31T12:19:47.323 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.324 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-08-31T12:19:47.325 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/54 2024-08-31T12:19:47.325 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.327 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-08-31T12:19:47.327 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/55 2024-08-31T12:19:47.328 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.329 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-08-31T12:19:47.330 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/56 2024-08-31T12:19:47.330 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.331 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-08-31T12:19:47.332 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/57 2024-08-31T12:19:47.332 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.333 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-08-31T12:19:47.334 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/58 2024-08-31T12:19:47.334 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.336 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-08-31T12:19:47.336 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/59 2024-08-31T12:19:47.337 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.338 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-08-31T12:19:47.339 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/60 2024-08-31T12:19:47.339 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.340 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-08-31T12:19:47.341 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/61 2024-08-31T12:19:47.341 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.342 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-08-31T12:19:47.343 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/62 2024-08-31T12:19:47.343 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.345 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-08-31T12:19:47.345 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/63 2024-08-31T12:19:47.346 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.347 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-08-31T12:19:47.348 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/64 2024-08-31T12:19:47.348 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.349 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-08-31T12:19:47.350 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/65 2024-08-31T12:19:47.350 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.352 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-08-31T12:19:47.352 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/66 2024-08-31T12:19:47.352 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.354 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-08-31T12:19:47.355 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/67 2024-08-31T12:19:47.355 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.356 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-08-31T12:19:47.357 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/68 2024-08-31T12:19:47.357 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.359 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-08-31T12:19:47.359 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/69 2024-08-31T12:19:47.359 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.360 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-08-31T12:19:47.361 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/70 2024-08-31T12:19:47.362 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.363 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-08-31T12:19:47.364 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/71 2024-08-31T12:19:47.364 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.365 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-08-31T12:19:47.366 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/72 2024-08-31T12:19:47.366 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.367 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-08-31T12:19:47.368 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/73 2024-08-31T12:19:47.368 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.369 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-08-31T12:19:47.370 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/74 2024-08-31T12:19:47.370 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.372 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-08-31T12:19:47.373 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/75 2024-08-31T12:19:47.373 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.374 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-08-31T12:19:47.375 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/76 2024-08-31T12:19:47.375 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.376 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-08-31T12:19:47.377 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/77 2024-08-31T12:19:47.377 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.378 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-08-31T12:19:47.379 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/78 2024-08-31T12:19:47.379 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.381 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-08-31T12:19:47.382 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/79 2024-08-31T12:19:47.382 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.383 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-08-31T12:19:47.384 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/80 2024-08-31T12:19:47.384 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.385 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-08-31T12:19:47.386 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/81 2024-08-31T12:19:47.386 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.387 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-08-31T12:19:47.388 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/82 2024-08-31T12:19:47.388 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.390 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-08-31T12:19:47.391 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/83 2024-08-31T12:19:47.391 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.392 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-08-31T12:19:47.393 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/84 2024-08-31T12:19:47.393 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.394 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-08-31T12:19:47.395 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/85 2024-08-31T12:19:47.395 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.396 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-08-31T12:19:47.397 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/86 2024-08-31T12:19:47.397 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.399 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-08-31T12:19:47.400 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/87 2024-08-31T12:19:47.400 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.401 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-08-31T12:19:47.402 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/88 2024-08-31T12:19:47.402 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.403 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-08-31T12:19:47.404 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/89 2024-08-31T12:19:47.404 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.405 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-08-31T12:19:47.406 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/90 2024-08-31T12:19:47.406 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.407 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-08-31T12:19:47.409 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/91 2024-08-31T12:19:47.409 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.410 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-08-31T12:19:47.411 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/92 2024-08-31T12:19:47.411 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.412 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-08-31T12:19:47.413 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/93 2024-08-31T12:19:47.413 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.414 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-08-31T12:19:47.415 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/94 2024-08-31T12:19:47.415 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.416 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-08-31T12:19:47.417 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/95 2024-08-31T12:19:47.417 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.419 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-08-31T12:19:47.420 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/96 2024-08-31T12:19:47.420 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.421 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-08-31T12:19:47.422 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/97 2024-08-31T12:19:47.422 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.423 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-08-31T12:19:47.424 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/98 2024-08-31T12:19:47.424 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.426 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-08-31T12:19:47.427 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/99 2024-08-31T12:19:47.427 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.428 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-08-31T12:19:47.429 INFO:tasks.workunit.client.0.smithi164.stderr:+ stat .snap/foo/100 2024-08-31T12:19:47.429 INFO:tasks.workunit.client.0.smithi164.stderr:+ grep No such file 2024-08-31T12:19:47.431 INFO:tasks.workunit.client.0.smithi164.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-08-31T12:19:47.431 INFO:tasks.workunit.client.0.smithi164.stderr:+ rmdir .snap/foo 2024-08-31T12:19:47.442 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo OK 2024-08-31T12:19:47.443 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2024-08-31T12:19:47.443 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:19:47.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:19:47.507 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-08-31T12:19:47.507 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-08-31T12:19:47.564 INFO:tasks.workunit.client.0.smithi164.stderr:+ set -e 2024-08-31T12:19:47.564 INFO:tasks.workunit.client.0.smithi164.stderr:+ sudo git config --global http.sslVerify false 2024-08-31T12:19:47.577 INFO:tasks.workunit.client.0.smithi164.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-08-31T12:19:47.591 INFO:tasks.workunit.client.0.smithi164.stderr:+ retried=false 2024-08-31T12:19:47.591 INFO:tasks.workunit.client.0.smithi164.stderr:+ trap -- retry EXIT 2024-08-31T12:19:47.591 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm -rf ceph 2024-08-31T12:19:47.592 INFO:tasks.workunit.client.0.smithi164.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-08-31T12:19:47.595 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into 'ceph'... 2024-08-31T12:19:48.842 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-08-31T12:19:48.842 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-31T12:19:48.842 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-31T12:19:48.845 INFO:tasks.ceph.mds.d:Started 2024-08-31T12:19:48.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:48.950 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2024-08-31T12:19:49.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 -- 172.21.15.164:0/430403856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 msgr2=0x7f6c84156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/430403856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c84156e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c740098a0 tx=0x7f6c7401f030 comp rx=0 tx=0).stop 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 -- 172.21.15.164:0/430403856 shutdown_connections 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/430403856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c84156e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 -- 172.21.15.164:0/430403856 >> 172.21.15.164:0/430403856 conn(0x7f6c840ccf20 msgr2=0x7f6c840cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 -- 172.21.15.164:0/430403856 shutdown_connections 2024-08-31T12:19:49.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:48.996+0000 7f6c8bc00640 1 -- 172.21.15.164:0/430403856 wait complete. 2024-08-31T12:19:49.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 Processor -- start 2024-08-31T12:19:49.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- start start 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c841f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 0x7f6c840c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8415d220 0x7f6c84151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84159c90 con 0x7f6c8415ce10 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8415a2e0 con 0x7f6c8415d220 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6c84159f70 con 0x7f6c84074e20 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c7be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 0x7f6c840c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8415d220 0x7f6c84151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c7be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 0x7f6c840c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36766/0 (socket says 172.21.15.164:36766) 2024-08-31T12:19:49.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c841f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c7be00640 1 -- 172.21.15.164:0/1044572099 learned_addr learned my addr 172.21.15.164:0/1044572099 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 -- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8415d220 msgr2=0x7f6c84151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8415d220 0x7f6c84151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 -- 172.21.15.164:0/1044572099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 msgr2=0x7f6c840c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 0x7f6c840c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 -- 172.21.15.164:0/1044572099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c841f5b40 con 0x7f6c84074e20 2024-08-31T12:19:49.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c89200640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c841f5600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c740af000 tx=0x7f6c74005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740bf070 con 0x7f6c84074e20 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c740036f0 con 0x7f6c84074e20 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c841f27c0 con 0x7f6c84074e20 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740b5040 con 0x7f6c84074e20 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.000+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c840c6040 con 0x7f6c84074e20 2024-08-31T12:19:49.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.004+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c84071e40 con 0x7f6c84074e20 2024-08-31T12:19:49.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.004+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6c74003b40 con 0x7f6c84074e20 2024-08-31T12:19:49.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.004+0000 7f6c81600640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 0x7f6c600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:49.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.004+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(52..52 src has 1..52) ==== 6762+0+0 (secure 0 0 0) 0x7f6c741300f0 con 0x7f6c84074e20 2024-08-31T12:19:49.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.004+0000 7f6c7be00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 0x7f6c600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:49.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.008+0000 7f6c7be00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 0x7f6c600745d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c84071180 tx=0x7f6c6c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:49.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.016+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6c740c8080 con 0x7f6c84074e20 2024-08-31T12:19:49.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.236+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c840c5ae0 con 0x7f6c84074e20 2024-08-31T12:19:49.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.236+0000 7f6c81600640 1 -- 172.21.15.164:0/1044572099 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6061 (secure 0 0 0) 0x7f6c74018b90 con 0x7f6c84074e20 2024-08-31T12:19:49.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:49.241 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":20,"btime":"2024-08-31T12:19:39:811145+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:19:49.241 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 20 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 msgr2=0x7f6c600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 0x7f6c600745d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c84071180 tx=0x7f6c6c009040 comp rx=0 tx=0).stop 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 msgr2=0x7f6c841f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c841f5600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c740af000 tx=0x7f6c74005760 comp rx=0 tx=0).stop 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 shutdown_connections 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f6c600720c0 0x7f6c600745d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8415d220 0x7f6c84151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c8415ce10 0x7f6c840c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 --2- 172.21.15.164:0/1044572099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84074e20 0x7f6c841f5600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:49.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 >> 172.21.15.164:0/1044572099 conn(0x7f6c840ccf20 msgr2=0x7f6c840711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:49.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 shutdown_connections 2024-08-31T12:19:49.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:49.240+0000 7f6c8bc00640 1 -- 172.21.15.164:0/1044572099 wait complete. 2024-08-31T12:19:49.263 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-08-31T12:19:51.264 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:19:51.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 -- 172.21.15.164:0/2015420969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f24152a10 msgr2=0x7f4f240c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2015420969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f24152a10 0x7f4f240c9330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009c80 tx=0x7f4f1c01f5a0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 -- 172.21.15.164:0/2015420969 shutdown_connections 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2015420969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f24152a10 0x7f4f240c9330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 -- 172.21.15.164:0/2015420969 >> 172.21.15.164:0/2015420969 conn(0x7f4f240ccf20 msgr2=0x7f4f240cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 -- 172.21.15.164:0/2015420969 shutdown_connections 2024-08-31T12:19:51.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.416+0000 7f4f2a200640 1 -- 172.21.15.164:0/2015420969 wait complete. 2024-08-31T12:19:51.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 Processor -- start 2024-08-31T12:19:51.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- start start 2024-08-31T12:19:51.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f240c1f40 0x7f4f2414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:51.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f24152a10 0x7f4f240c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:51.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:51.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24074e30 con 0x7f4f2415bc70 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f240c8030 con 0x7f4f24152a10 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4f24074fb0 con 0x7f4f240c1f40 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36786/0 (socket says 172.21.15.164:36786) 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 -- 172.21.15.164:0/2182374970 learned_addr learned my addr 172.21.15.164:0/2182374970 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23400640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f240c1f40 0x7f4f2414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f1aa00640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f24152a10 0x7f4f240c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 -- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f240c1f40 msgr2=0x7f4f2414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f240c1f40 0x7f4f2414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 -- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f24152a10 msgr2=0x7f4f240c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f24152a10 0x7f4f240c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 -- 172.21.15.164:0/2182374970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f240c5e90 con 0x7f4f2415bc70 2024-08-31T12:19:51.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f23e00640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009bd0 tx=0x7f4f1c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:51.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0afaa0 con 0x7f4f2415bc70 2024-08-31T12:19:51.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f1c0afd30 con 0x7f4f2415bc70 2024-08-31T12:19:51.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f24159ce0 con 0x7f4f2415bc70 2024-08-31T12:19:51.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c004240 con 0x7f4f2415bc70 2024-08-31T12:19:51.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.420+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2415a2f0 con 0x7f4f2415bc70 2024-08-31T12:19:51.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.424+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f240c6060 con 0x7f4f2415bc70 2024-08-31T12:19:51.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.424+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4f1c0043e0 con 0x7f4f2415bc70 2024-08-31T12:19:51.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.424+0000 7f4f1be00640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 0x7f4f00074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:19:51.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.424+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6874+0+0 (secure 0 0 0) 0x7f4f1c132290 con 0x7f4f2415bc70 2024-08-31T12:19:51.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.424+0000 7f4f23400640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 0x7f4f00074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:19:51.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.428+0000 7f4f23400640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 0x7f4f00074600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f14000f70 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:19:51.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.428+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4f1c0c9060 con 0x7f4f2415bc70 2024-08-31T12:19:51.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f241560a0 con 0x7f4f2415bc70 2024-08-31T12:19:51.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f1be00640 1 -- 172.21.15.164:0/2182374970 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f4f1c0ac050 con 0x7f4f2415bc70 2024-08-31T12:19:51.631 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:19:51.631 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:19:51.631 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:19:51.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 msgr2=0x7f4f00074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:51.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 0x7f4f00074600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f14000f70 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2024-08-31T12:19:51.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 msgr2=0x7f4f240c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009bd0 tx=0x7f4f1c0093d0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 shutdown_connections 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4f000720f0 0x7f4f00074600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f2415bc70 0x7f4f240c49c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f24152a10 0x7f4f240c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 --2- 172.21.15.164:0/2182374970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f240c1f40 0x7f4f2414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 >> 172.21.15.164:0/2182374970 conn(0x7f4f240ccf20 msgr2=0x7f4f24071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 shutdown_connections 2024-08-31T12:19:51.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:19:51.628+0000 7f4f2a200640 1 -- 172.21.15.164:0/2182374970 wait complete. 2024-08-31T12:19:51.653 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-08-31T12:19:51.653 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 17 secs before thrashing 2024-08-31T12:20:05.324 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:20:05.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:20:08.654 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:08.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 -- 172.21.15.164:0/3256451615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152780 msgr2=0x7f2c48073b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:08.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/3256451615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152780 0x7f2c48073b00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009840 tx=0x7f2c3801c820 comp rx=0 tx=0).stop 2024-08-31T12:20:08.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 -- 172.21.15.164:0/3256451615 shutdown_connections 2024-08-31T12:20:08.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/3256451615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152780 0x7f2c48073b00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:08.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 -- 172.21.15.164:0/3256451615 >> 172.21.15.164:0/3256451615 conn(0x7f2c480c9c90 msgr2=0x7f2c480ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:08.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 -- 172.21.15.164:0/3256451615 shutdown_connections 2024-08-31T12:20:08.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.816+0000 7f2c4ea00640 1 -- 172.21.15.164:0/3256451615 wait complete. 2024-08-31T12:20:08.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 Processor -- start 2024-08-31T12:20:08.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 -- start start 2024-08-31T12:20:08.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c480c5b80 0x7f2c48163520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:08.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c48152780 0x7f2c48156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:08.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480c6d90 con 0x7f2c48152b90 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480c6c10 con 0x7f2c480c5b80 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ea00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2c480c6fe0 con 0x7f2c48152780 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41522/0 (socket says 172.21.15.164:41522) 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c4ca00640 1 -- 172.21.15.164:0/399725712 learned_addr learned my addr 172.21.15.164:0/399725712 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c47400640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c48152780 0x7f2c48156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.820+0000 7f2c47e00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c480c5b80 0x7f2c48163520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 -- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c48152780 msgr2=0x7f2c48156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c48152780 0x7f2c48156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 -- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c480c5b80 msgr2=0x7f2c48163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:08.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c480c5b80 0x7f2c48163520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:08.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 -- 172.21.15.164:0/399725712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48163a60 con 0x7f2c48152b90 2024-08-31T12:20:08.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ca00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000cb40 tx=0x7f2c4000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:08.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40016020 con 0x7f2c48152b90 2024-08-31T12:20:08.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c4000aae0 con 0x7f2c48152b90 2024-08-31T12:20:08.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c481f93f0 con 0x7f2c48152b90 2024-08-31T12:20:08.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40012420 con 0x7f2c48152b90 2024-08-31T12:20:08.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c48148e10 con 0x7f2c48152b90 2024-08-31T12:20:08.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c480c9970 con 0x7f2c48152b90 2024-08-31T12:20:08.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.824+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2c40019020 con 0x7f2c48152b90 2024-08-31T12:20:08.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.828+0000 7f2c3fe00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 0x7f2c280745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:08.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.828+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f2c400931b0 con 0x7f2c48152b90 2024-08-31T12:20:08.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.828+0000 7f2c47e00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 0x7f2c280745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:08.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.828+0000 7f2c47e00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 0x7f2c280745d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c380af000 tx=0x7f2c3801b060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:08.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:08.832+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2c40020020 con 0x7f2c48152b90 2024-08-31T12:20:09.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.136+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c4814c670 con 0x7f2c48152b90 2024-08-31T12:20:09.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.136+0000 7f2c3fe00640 1 -- 172.21.15.164:0/399725712 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f2c48159370 con 0x7f2c48152b90 2024-08-31T12:20:09.140 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:09.140 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:09.141 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:09.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 msgr2=0x7f2c280745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 0x7f2c280745d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c380af000 tx=0x7f2c3801b060 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 msgr2=0x7f2c48147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000cb40 tx=0x7f2c4000cc30 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 shutdown_connections 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f2c280720c0 0x7f2c280745d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c48152b90 0x7f2c48147a70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c48152780 0x7f2c48156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 --2- 172.21.15.164:0/399725712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c480c5b80 0x7f2c48163520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 >> 172.21.15.164:0/399725712 conn(0x7f2c480c9c90 msgr2=0x7f2c48155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 shutdown_connections 2024-08-31T12:20:09.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.140+0000 7f2c4ea00640 1 -- 172.21.15.164:0/399725712 wait complete. 2024-08-31T12:20:09.174 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=0) 2024-08-31T12:20:09.174 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-31T12:20:09.174 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:20:09.195 INFO:tasks.ceph.mds.a:Stopped 2024-08-31T12:20:09.195 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:09.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 -- 172.21.15.164:0/2320522841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040c50d0 msgr2=0x7f250415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 --2- 172.21.15.164:0/2320522841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040c50d0 0x7f250415d7b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2504157570 tx=0x7f24fc01cd80 comp rx=0 tx=0).stop 2024-08-31T12:20:09.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 -- 172.21.15.164:0/2320522841 shutdown_connections 2024-08-31T12:20:09.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 --2- 172.21.15.164:0/2320522841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040c50d0 0x7f250415d7b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 --2- 172.21.15.164:0/2320522841 >> v2:172.21.15.184:3300/0 conn(0x7f25040c3e40 0x7f250415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 -- 172.21.15.164:0/2320522841 >> 172.21.15.164:0/2320522841 conn(0x7f2504071a40 msgr2=0x7f250406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:09.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 -- 172.21.15.164:0/2320522841 shutdown_connections 2024-08-31T12:20:09.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.392+0000 7f2509c00640 1 -- 172.21.15.164:0/2320522841 wait complete. 2024-08-31T12:20:09.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 Processor -- start 2024-08-31T12:20:09.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- start start 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25040c3e40 0x7f25040c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25040c50d0 0x7f250414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2504166dd0 con 0x7f25040b4090 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2504166c50 con 0x7f25040c50d0 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2504166f50 con 0x7f25040c3e40 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:09.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41548/0 (socket says 172.21.15.164:41548) 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 -- 172.21.15.164:0/1289905452 learned_addr learned my addr 172.21.15.164:0/1289905452 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502000640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25040c3e40 0x7f25040c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2503400640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25040c50d0 0x7f250414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 -- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25040c3e40 msgr2=0x7f25040c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25040c3e40 0x7f25040c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 -- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25040c50d0 msgr2=0x7f250414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25040c50d0 0x7f250414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 -- 172.21.15.164:0/1289905452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25040c4e70 con 0x7f25040b4090 2024-08-31T12:20:09.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2502a00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f24f400b440 tx=0x7f24f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4015020 con 0x7f25040b4090 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24f4011980 con 0x7f25040b4090 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4011dd0 con 0x7f25040b4090 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250415c4d0 con 0x7f25040b4090 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.396+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250414f950 con 0x7f25040b4090 2024-08-31T12:20:09.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.400+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25040ccea0 con 0x7f25040b4090 2024-08-31T12:20:09.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.400+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f24f4018020 con 0x7f25040b4090 2024-08-31T12:20:09.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.400+0000 7f24faa00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 0x7f24e40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:09.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.400+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f24f4092e60 con 0x7f25040b4090 2024-08-31T12:20:09.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.400+0000 7f2502000640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 0x7f24e40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:09.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.404+0000 7f2502000640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 0x7f24e40745d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24f00058d0 tx=0x7f24f0005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:09.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.408+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f24f401f030 con 0x7f25040b4090 2024-08-31T12:20:09.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.652+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25040cda30 con 0x7f25040b4090 2024-08-31T12:20:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.652+0000 7f24faa00640 1 -- 172.21.15.164:0/1289905452 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f24f400d040 con 0x7f25040b4090 2024-08-31T12:20:09.656 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:09.656 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 msgr2=0x7f24e40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 0x7f24e40745d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24f00058d0 tx=0x7f24f0005860 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 msgr2=0x7f250415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f24f400b440 tx=0x7f24f400b900 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 shutdown_connections 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f24e40720c0 0x7f24e40745d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25040c50d0 0x7f250414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25040c3e40 0x7f25040c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 --2- 172.21.15.164:0/1289905452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25040b4090 0x7f250415ad80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 >> 172.21.15.164:0/1289905452 conn(0x7f2504071a40 msgr2=0x7f2504151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 shutdown_connections 2024-08-31T12:20:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:09.656+0000 7f2509c00640 1 -- 172.21.15.164:0/1289905452 wait complete. 2024-08-31T12:20:09.680 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:11.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 -- 172.21.15.164:0/2144455213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 msgr2=0x7fd910152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 --2- 172.21.15.164:0/2144455213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd910152a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009840 tx=0x7fd8fc01f010 comp rx=0 tx=0).stop 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 -- 172.21.15.164:0/2144455213 shutdown_connections 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 --2- 172.21.15.164:0/2144455213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd910152a10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 -- 172.21.15.164:0/2144455213 >> 172.21.15.164:0/2144455213 conn(0x7fd9100ccf20 msgr2=0x7fd9100cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 -- 172.21.15.164:0/2144455213 shutdown_connections 2024-08-31T12:20:11.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.836+0000 7fd916e00640 1 -- 172.21.15.164:0/2144455213 wait complete. 2024-08-31T12:20:11.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 Processor -- start 2024-08-31T12:20:11.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 -- start start 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 0x7fd910154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015bc70 0x7fd9101f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100c8030 con 0x7fd9100c1f40 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100c3150 con 0x7fd9100c9330 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.840+0000 7fd916e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd910074e30 con 0x7fd91015bc70 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41556/0 (socket says 172.21.15.164:41556) 2024-08-31T12:20:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 -- 172.21.15.164:0/1375405215 learned_addr learned my addr 172.21.15.164:0/1375405215 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90f400640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 0x7fd910154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd914e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015bc70 0x7fd9101f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 -- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015bc70 msgr2=0x7fd9101f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015bc70 0x7fd9101f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 -- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 msgr2=0x7fd910154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 0x7fd910154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 -- 172.21.15.164:0/1375405215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9100c67c0 con 0x7fd9100c1f40 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90f400640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 0x7fd910154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd90fe00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c3c0 tx=0x7fd90000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900017070 con 0x7fd9100c1f40 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9000053c0 con 0x7fd9100c1f40 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900003860 con 0x7fd9100c1f40 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd910154b60 con 0x7fd9100c1f40 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101f3bc0 con 0x7fd9100c1f40 2024-08-31T12:20:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.844+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd910152a10 con 0x7fd9100c1f40 2024-08-31T12:20:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.848+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd90001a070 con 0x7fd9100c1f40 2024-08-31T12:20:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.848+0000 7fd907e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 0x7fd8f00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.848+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7fd9000923a0 con 0x7fd9100c1f40 2024-08-31T12:20:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.848+0000 7fd90f400640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 0x7fd8f00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.848+0000 7fd90f400640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 0x7fd8f00745d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b2000 tx=0x7fd8fc01d850 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:11.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:11.852+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd90005d800 con 0x7fd9100c1f40 2024-08-31T12:20:12.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9101560a0 con 0x7fd9100c1f40 2024-08-31T12:20:12.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd907e00640 1 -- 172.21.15.164:0/1375405215 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7fd90005d100 con 0x7fd9100c1f40 2024-08-31T12:20:12.075 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:12.075 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:12.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 msgr2=0x7fd8f00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:12.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 0x7fd8f00745d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b2000 tx=0x7fd8fc01d850 comp rx=0 tx=0).stop 2024-08-31T12:20:12.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 msgr2=0x7fd91014fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c3c0 tx=0x7fd90000c880 comp rx=0 tx=0).stop 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 shutdown_connections 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd8f00720c0 0x7fd8f00745d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015bc70 0x7fd9101f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9100c9330 0x7fd910154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 --2- 172.21.15.164:0/1375405215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9100c1f40 0x7fd91014fe80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 >> 172.21.15.164:0/1375405215 conn(0x7fd9100ccf20 msgr2=0x7fd91015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 shutdown_connections 2024-08-31T12:20:12.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:12.072+0000 7fd916e00640 1 -- 172.21.15.164:0/1375405215 wait complete. 2024-08-31T12:20:12.098 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:14.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- 172.21.15.164:0/4261026565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 msgr2=0x7f9d7000cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 --2- 172.21.15.164:0/4261026565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d7000cae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0c3430 tx=0x7f9d8401f9e0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- 172.21.15.164:0/4261026565 shutdown_connections 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 --2- 172.21.15.164:0/4261026565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d7000cae0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- 172.21.15.164:0/4261026565 >> 172.21.15.164:0/4261026565 conn(0x7f9d8c0ccf20 msgr2=0x7f9d8c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- 172.21.15.164:0/4261026565 shutdown_connections 2024-08-31T12:20:14.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- 172.21.15.164:0/4261026565 wait complete. 2024-08-31T12:20:14.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 Processor -- start 2024-08-31T12:20:14.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.259+0000 7f9d92800640 1 -- start start 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c0cc710 0x7f9d8c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c1514c0 0x7f9d8c1f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c158980 con 0x7f9d70006470 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c158800 con 0x7f9d8c0cc710 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c0cbd70 con 0x7f9d8c1514c0 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41582/0 (socket says 172.21.15.164:41582) 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 -- 172.21.15.164:0/561791877 learned_addr learned my addr 172.21.15.164:0/561791877 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:14.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d83e00640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c0cc710 0x7f9d8c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8be00640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c1514c0 0x7f9d8c1f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 -- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c1514c0 msgr2=0x7f9d8c1f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c1514c0 0x7f9d8c1f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 -- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c0cc710 msgr2=0x7f9d8c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c0cc710 0x7f9d8c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 -- 172.21.15.164:0/561791877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c1f23a0 con 0x7f9d70006470 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d8b400640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c011880 tx=0x7f9d7c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00fd50 con 0x7f9d70006470 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d7c016070 con 0x7f9d70006470 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c1527d0 con 0x7f9d70006470 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0126b0 con 0x7f9d70006470 2024-08-31T12:20:14.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c1f25b0 con 0x7f9d70006470 2024-08-31T12:20:14.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.263+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8c1520f0 con 0x7f9d70006470 2024-08-31T12:20:14.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.267+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9d7c018030 con 0x7f9d70006470 2024-08-31T12:20:14.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.267+0000 7f9d83400640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 0x7f9d68074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:14.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.267+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f9d7c093fa0 con 0x7f9d70006470 2024-08-31T12:20:14.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.267+0000 7f9d83e00640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 0x7f9d68074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:14.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.267+0000 7f9d83e00640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 0x7f9d68074600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c076c90 tx=0x7f9d74006c90 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:14.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.271+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9d7c05eeb0 con 0x7f9d70006470 2024-08-31T12:20:14.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.467+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d8c1557f0 con 0x7f9d70006470 2024-08-31T12:20:14.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.467+0000 7f9d83400640 1 -- 172.21.15.164:0/561791877 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f9d7c063670 con 0x7f9d70006470 2024-08-31T12:20:14.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:14.473 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:14.473 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 msgr2=0x7f9d68074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 0x7f9d68074600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c076c90 tx=0x7f9d74006c90 comp rx=0 tx=0).stop 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 msgr2=0x7f9d8c1f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c011880 tx=0x7f9d7c011d40 comp rx=0 tx=0).stop 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 shutdown_connections 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9d680720f0 0x7f9d68074600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c1514c0 0x7f9d8c1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c0cc710 0x7f9d8c150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 --2- 172.21.15.164:0/561791877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d70006470 0x7f9d8c1f1e60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:14.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 >> 172.21.15.164:0/561791877 conn(0x7f9d8c0ccf20 msgr2=0x7f9d8c14e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:14.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 shutdown_connections 2024-08-31T12:20:14.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:14.471+0000 7f9d92800640 1 -- 172.21.15.164:0/561791877 wait complete. 2024-08-31T12:20:14.495 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:16.496 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:16.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 -- 172.21.15.164:0/2825072733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 msgr2=0x7f9c20074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 --2- 172.21.15.164:0/2825072733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20074720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009c80 tx=0x7f9c1801f5a0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 -- 172.21.15.164:0/2825072733 shutdown_connections 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 --2- 172.21.15.164:0/2825072733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20074720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 --2- 172.21.15.164:0/2825072733 >> v2:172.21.15.184:3300/0 conn(0x7f9c2015bc70 0x7f9c20152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 -- 172.21.15.164:0/2825072733 >> 172.21.15.164:0/2825072733 conn(0x7f9c200ccf20 msgr2=0x7f9c200cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 -- 172.21.15.164:0/2825072733 shutdown_connections 2024-08-31T12:20:16.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 -- 172.21.15.164:0/2825072733 wait complete. 2024-08-31T12:20:16.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.659+0000 7f9c25800640 1 Processor -- start 2024-08-31T12:20:16.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- start start 2024-08-31T12:20:16.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:16.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:16.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c2015bc70 0x7f9c2014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200c8030 con 0x7f9c200c1f40 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200c3150 con 0x7f9c2015bc70 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9c20074c60 con 0x7f9c200c9330 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37112/0 (socket says 172.21.15.164:37112) 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 -- 172.21.15.164:0/1332399348 learned_addr learned my addr 172.21.15.164:0/1332399348 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1f400640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c2015bc70 0x7f9c2014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c16000640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 -- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 msgr2=0x7f9c20158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 -- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c2015bc70 msgr2=0x7f9c2014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c2015bc70 0x7f9c2014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 -- 172.21.15.164:0/1332399348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c20158480 con 0x7f9c200c1f40 2024-08-31T12:20:16.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c1ea00640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000e970 tx=0x7f9c1000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:16.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000cd80 con 0x7f9c200c1f40 2024-08-31T12:20:16.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c10004020 con 0x7f9c200c1f40 2024-08-31T12:20:16.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c200c4cd0 con 0x7f9c200c1f40 2024-08-31T12:20:16.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10004470 con 0x7f9c200c1f40 2024-08-31T12:20:16.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201f0270 con 0x7f9c200c1f40 2024-08-31T12:20:16.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.663+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20074720 con 0x7f9c200c1f40 2024-08-31T12:20:16.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.667+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9c10003600 con 0x7f9c200c1f40 2024-08-31T12:20:16.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.667+0000 7f9c17400640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 0x7f9bfc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:16.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.667+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f9c10093850 con 0x7f9c200c1f40 2024-08-31T12:20:16.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.667+0000 7f9c16000640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 0x7f9bfc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:16.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.667+0000 7f9c16000640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 0x7f9bfc074600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9c200c8aa0 tx=0x7f9c08009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:16.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.671+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9c1005e650 con 0x7f9c200c1f40 2024-08-31T12:20:16.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.871+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c200c87f0 con 0x7f9c200c1f40 2024-08-31T12:20:16.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.871+0000 7f9c17400640 1 -- 172.21.15.164:0/1332399348 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f9c10062e10 con 0x7f9c200c1f40 2024-08-31T12:20:16.877 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:16.877 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:16.877 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:16.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 msgr2=0x7f9bfc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:16.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 0x7f9bfc074600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9c200c8aa0 tx=0x7f9c08009040 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 msgr2=0x7f9c20154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000e970 tx=0x7f9c1000ee30 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 shutdown_connections 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9bfc0720f0 0x7f9bfc074600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c2015bc70 0x7f9c2014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c200c9330 0x7f9c20158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 --2- 172.21.15.164:0/1332399348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c200c1f40 0x7f9c20154320 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 >> 172.21.15.164:0/1332399348 conn(0x7f9c200ccf20 msgr2=0x7f9c2014fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 shutdown_connections 2024-08-31T12:20:16.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:16.875+0000 7f9c25800640 1 -- 172.21.15.164:0/1332399348 wait complete. 2024-08-31T12:20:16.899 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:18.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:19.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 -- 172.21.15.164:0/4134592092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b8815c530 msgr2=0x7f8b8806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 --2- 172.21.15.164:0/4134592092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b8815c530 0x7f8b8806e510 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009c80 tx=0x7f8b8001f5a0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 -- 172.21.15.164:0/4134592092 shutdown_connections 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 --2- 172.21.15.164:0/4134592092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b8815c530 0x7f8b8806e510 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 --2- 172.21.15.164:0/4134592092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b88071320 0x7f8b881526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 -- 172.21.15.164:0/4134592092 >> 172.21.15.164:0/4134592092 conn(0x7f8b880ce2c0 msgr2=0x7f8b880ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 -- 172.21.15.164:0/4134592092 shutdown_connections 2024-08-31T12:20:19.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.059+0000 7f8b8e600640 1 -- 172.21.15.164:0/4134592092 wait complete. 2024-08-31T12:20:19.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 Processor -- start 2024-08-31T12:20:19.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 -- start start 2024-08-31T12:20:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 0x7f8b88153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 0x7f8b88151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8b880c53c0 con 0x7f8b88071320 2024-08-31T12:20:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b880c7660 con 0x7f8b8806e100 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8e600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8b88071730 con 0x7f8b8815c530 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37124/0 (socket says 172.21.15.164:37124) 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 -- 172.21.15.164:0/616466396 learned_addr learned my addr 172.21.15.164:0/616466396 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8d200640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 0x7f8b88153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8dc00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 0x7f8b88151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 -- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 msgr2=0x7f8b88151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 0x7f8b88151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 -- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 msgr2=0x7f8b88153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 0x7f8b88153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 -- 172.21.15.164:0/616466396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b880c1d70 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8dc00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 0x7f8b88151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b8d200640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 0x7f8b88153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b87e00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c3c0 tx=0x7f8b7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.063+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74017070 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b740053c0 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8814f390 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74003880 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b881f2ab0 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b88070f30 con 0x7f8b88071320 2024-08-31T12:20:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8b7401a070 con 0x7f8b88071320 2024-08-31T12:20:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b84c00640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 0x7f8b68074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f8b740922e0 con 0x7f8b88071320 2024-08-31T12:20:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.067+0000 7f8b8d200640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 0x7f8b68074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.071+0000 7f8b8d200640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 0x7f8b68074600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00bbd0 tx=0x7f8b7c00b5b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.071+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8b7405d7c0 con 0x7f8b88071320 2024-08-31T12:20:19.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.271+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b8815cb50 con 0x7f8b88071320 2024-08-31T12:20:19.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.271+0000 7f8b84c00640 1 -- 172.21.15.164:0/616466396 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f8b7405d0c0 con 0x7f8b88071320 2024-08-31T12:20:19.276 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:19.276 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:19.277 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:19.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 msgr2=0x7f8b68074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 0x7f8b68074600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00bbd0 tx=0x7f8b7c00b5b0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 msgr2=0x7f8b881f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c3c0 tx=0x7f8b7400c880 comp rx=0 tx=0).stop 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 shutdown_connections 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8b680720f0 0x7f8b68074600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b8815c530 0x7f8b88151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b88071320 0x7f8b881f5b80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 --2- 172.21.15.164:0/616466396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b8806e100 0x7f8b88153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:19.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 >> 172.21.15.164:0/616466396 conn(0x7f8b880ce2c0 msgr2=0x7f8b8815be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:19.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 shutdown_connections 2024-08-31T12:20:19.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:19.275+0000 7f8b8e600640 1 -- 172.21.15.164:0/616466396 wait complete. 2024-08-31T12:20:19.298 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:21.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:21.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- 172.21.15.164:0/3911136914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c97e0 msgr2=0x7fa3f4156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:21.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 --2- 172.21.15.164:0/3911136914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c97e0 0x7fa3f4156b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009840 tx=0x7fa3e401c820 comp rx=0 tx=0).stop 2024-08-31T12:20:21.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- 172.21.15.164:0/3911136914 shutdown_connections 2024-08-31T12:20:21.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 --2- 172.21.15.164:0/3911136914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f415a370 0x7fa3f4164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 --2- 172.21.15.164:0/3911136914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c97e0 0x7fa3f4156b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- 172.21.15.164:0/3911136914 >> 172.21.15.164:0/3911136914 conn(0x7fa3f4071be0 msgr2=0x7fa3f406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:21.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- 172.21.15.164:0/3911136914 shutdown_connections 2024-08-31T12:20:21.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- 172.21.15.164:0/3911136914 wait complete. 2024-08-31T12:20:21.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 Processor -- start 2024-08-31T12:20:21.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.463+0000 7fa3f9600640 1 -- start start 2024-08-31T12:20:21.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c97e0 0x7fa3f41f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:21.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:21.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 0x7fa3f4160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41570b0 con 0x7fa3f4159f60 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f408cff0 con 0x7fa3f415a370 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f41596f0 con 0x7fa3f40c97e0 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37140/0 (socket says 172.21.15.164:37140) 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 -- 172.21.15.164:0/1685864858 learned_addr learned my addr 172.21.15.164:0/1685864858 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f2a00640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c97e0 0x7fa3f41f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f3400640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 0x7fa3f4160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 -- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c97e0 msgr2=0x7fa3f41f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c97e0 0x7fa3f41f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 -- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 msgr2=0x7fa3f4160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 0x7fa3f4160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 -- 172.21.15.164:0/1685864858 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f41f4690 con 0x7fa3f4159f60 2024-08-31T12:20:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f3400640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 0x7fa3f4160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3ea000640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00c430 tx=0x7fa3dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011790 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3dc017070 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f41f69b0 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011ce0 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f415d500 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.467+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f40c5d30 con 0x7fa3f4159f60 2024-08-31T12:20:21.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.471+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa3dc01c460 con 0x7fa3f4159f60 2024-08-31T12:20:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.471+0000 7fa3eb400640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 0x7fa3d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.471+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7fa3dc092f10 con 0x7fa3f4159f60 2024-08-31T12:20:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.471+0000 7fa3f2a00640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 0x7fa3d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.471+0000 7fa3f2a00640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 0x7fa3d0074600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40af000 tx=0x7fa3e401b060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:21.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.475+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa3dc05e3b0 con 0x7fa3f4159f60 2024-08-31T12:20:21.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f40cc610 con 0x7fa3f4159f60 2024-08-31T12:20:21.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3eb400640 1 -- 172.21.15.164:0/1685864858 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7fa3dc05dcb0 con 0x7fa3f4159f60 2024-08-31T12:20:21.678 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:21.679 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:21.679 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:21.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 msgr2=0x7fa3d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 0x7fa3d0074600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40af000 tx=0x7fa3e401b060 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 msgr2=0x7fa3f40c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00c430 tx=0x7fa3dc00c8f0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 shutdown_connections 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa3d00720f0 0x7fa3d0074600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f415a370 0x7fa3f4160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3f4159f60 0x7fa3f40c80f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 --2- 172.21.15.164:0/1685864858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c97e0 0x7fa3f41f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 >> 172.21.15.164:0/1685864858 conn(0x7fa3f4071be0 msgr2=0x7fa3f4158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 shutdown_connections 2024-08-31T12:20:21.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:21.675+0000 7fa3f9600640 1 -- 172.21.15.164:0/1685864858 wait complete. 2024-08-31T12:20:21.701 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:23.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 -- 172.21.15.164:0/3521489001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 msgr2=0x7f666c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 --2- 172.21.15.164:0/3521489001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f666c004c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66880c25b0 tx=0x7f667001d260 comp rx=0 tx=0).stop 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668d400640 1 -- 172.21.15.164:0/3521489001 reap_dead start 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 -- 172.21.15.164:0/3521489001 shutdown_connections 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 -- 172.21.15.164:0/3521489001 >> 172.21.15.164:0/3521489001 conn(0x7f66880ccf20 msgr2=0x7f66880cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:23.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 -- 172.21.15.164:0/3521489001 shutdown_connections 2024-08-31T12:20:23.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.863+0000 7f668f400640 1 -- 172.21.15.164:0/3521489001 wait complete. 2024-08-31T12:20:23.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 Processor -- start 2024-08-31T12:20:23.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 -- start start 2024-08-31T12:20:23.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66881558f0 0x7f66881574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 0x7f668814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f66880c8030 con 0x7f666c004810 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f66880c3150 con 0x7f668814fab0 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668f400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6688152a10 con 0x7f66881558f0 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37150/0 (socket says 172.21.15.164:37150) 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 -- 172.21.15.164:0/1874304087 learned_addr learned my addr 172.21.15.164:0/1874304087 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f667fe00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66881558f0 0x7f66881574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668d400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 0x7f668814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 -- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66881558f0 msgr2=0x7f66881574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:23.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66881558f0 0x7f66881574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 -- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 msgr2=0x7f668814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 0x7f668814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 -- 172.21.15.164:0/1874304087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668815a140 con 0x7f666c004810 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668d400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 0x7f668814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.867+0000 7f668ca00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6678006610 tx=0x7f66780039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678015070 con 0x7f666c004810 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6678011920 con 0x7f666c004810 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668815b5c0 con 0x7f666c004810 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678011d70 con 0x7f666c004810 2024-08-31T12:20:23.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66881f2a10 con 0x7f666c004810 2024-08-31T12:20:23.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66880c7920 con 0x7f666c004810 2024-08-31T12:20:23.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6678018070 con 0x7f666c004810 2024-08-31T12:20:23.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 0x7f66640745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:23.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f6678093d20 con 0x7f666c004810 2024-08-31T12:20:23.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.871+0000 7f667fe00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 0x7f66640745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:23.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.875+0000 7f667fe00640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 0x7f66640745d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66700ae000 tx=0x7f667001a000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:23.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:23.875+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f667805eb20 con 0x7f666c004810 2024-08-31T12:20:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66880c82f0 con 0x7f666c004810 2024-08-31T12:20:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f6685600640 1 -- 172.21.15.164:0/1874304087 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6889 (secure 0 0 0) 0x7f66780632e0 con 0x7f666c004810 2024-08-31T12:20:24.083 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:24.083 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"btime":"2024-08-31T12:19:49:798222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:19:39.811136+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":41,"addr":"172.21.15.164:6835/580774116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":580774116},{"type":"v1","addr":"172.21.15.164:6835","nonce":580774116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4992,"qdb_cluster":[4992]},"id":1}]} 2024-08-31T12:20:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 21 2024-08-31T12:20:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 msgr2=0x7f66640745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 0x7f66640745d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66700ae000 tx=0x7f667001a000 comp rx=0 tx=0).stop 2024-08-31T12:20:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 msgr2=0x7f6688159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6678006610 tx=0x7f66780039d0 comp rx=0 tx=0).stop 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 shutdown_connections 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f66640720c0 0x7f66640745d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668814fab0 0x7f668814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66881558f0 0x7f66881574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 --2- 172.21.15.164:0/1874304087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f666c004810 0x7f6688159c00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 >> 172.21.15.164:0/1874304087 conn(0x7f66880ccf20 msgr2=0x7f6688150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 shutdown_connections 2024-08-31T12:20:24.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:24.079+0000 7f668f400640 1 -- 172.21.15.164:0/1874304087 wait complete. 2024-08-31T12:20:24.105 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-08-31T12:20:26.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 -- 172.21.15.164:0/457443011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a24003a10 msgr2=0x7f9a24003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 --2- 172.21.15.164:0/457443011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a24003a10 0x7f9a24003e80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c610 tx=0x7f9a3001fad0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a42000640 1 -- 172.21.15.164:0/457443011 reap_dead start 2024-08-31T12:20:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 -- 172.21.15.164:0/457443011 shutdown_connections 2024-08-31T12:20:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 -- 172.21.15.164:0/457443011 >> 172.21.15.164:0/457443011 conn(0x7f9a3c0ccf20 msgr2=0x7f9a3c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 -- 172.21.15.164:0/457443011 shutdown_connections 2024-08-31T12:20:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.267+0000 7f9a44000640 1 -- 172.21.15.164:0/457443011 wait complete. 2024-08-31T12:20:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 Processor -- start 2024-08-31T12:20:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 -- start start 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 0x7f9a3c1ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a3c073d10 0x7f9a3c14a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c1599b0 con 0x7f9a3c074120 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c069fc0 con 0x7f9a3c073d10 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a44000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c159c90 con 0x7f9a24003a10 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a42000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a42000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44092/0 (socket says 172.21.15.164:44092) 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a42000640 1 -- 172.21.15.164:0/3833759140 learned_addr learned my addr 172.21.15.164:0/3833759140 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a40c00640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a3c073d10 0x7f9a3c14a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.271+0000 7f9a41600640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 0x7f9a3c1ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 -- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 msgr2=0x7f9a3c1ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 0x7f9a3c1ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 -- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a3c073d10 msgr2=0x7f9a3c14a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a3c073d10 0x7f9a3c14a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 -- 172.21.15.164:0/3833759140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c1ef510 con 0x7f9a3c074120 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a41600640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 0x7f9a3c1ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a42000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c4a00 tx=0x7f9a34011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34004440 con 0x7f9a3c074120 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34016070 con 0x7f9a3c074120 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400fb20 con 0x7f9a3c074120 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1eff00 con 0x7f9a3c074120 2024-08-31T12:20:26.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c15c5b0 con 0x7f9a3c074120 2024-08-31T12:20:26.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c157220 con 0x7f9a3c074120 2024-08-31T12:20:26.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.275+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9a3400fcc0 con 0x7f9a3c074120 2024-08-31T12:20:26.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.279+0000 7f9a39600640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 0x7f9a1c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.279+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6818+0+0 (secure 0 0 0) 0x7f9a34093960 con 0x7f9a3c074120 2024-08-31T12:20:26.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.279+0000 7f9a41600640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 0x7f9a1c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.279+0000 7f9a41600640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 0x7f9a1c074600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a300b0000 tx=0x7f9a300b4040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:26.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.283+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9a3405ee40 con 0x7f9a3c074120 2024-08-31T12:20:26.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.479+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a3c074c00 con 0x7f9a3c074120 2024-08-31T12:20:26.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a39600640 1 -- 172.21.15.164:0/3833759140 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6056 (secure 0 0 0) 0x7f9a3405e740 con 0x7f9a3c074120 2024-08-31T12:20:26.486 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:26.486 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":22,"btime":"2024-08-31T12:20:26:357254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:26.357250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:26.486 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 22 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 msgr2=0x7f9a1c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 0x7f9a1c074600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a300b0000 tx=0x7f9a300b4040 comp rx=0 tx=0).stop 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 msgr2=0x7f9a3c14a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c4a00 tx=0x7f9a34011be0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 shutdown_connections 2024-08-31T12:20:26.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f9a1c0720f0 0x7f9a1c074600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3c074120 0x7f9a3c14a600 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a3c073d10 0x7f9a3c14a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 --2- 172.21.15.164:0/3833759140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a24003a10 0x7f9a3c1ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 >> 172.21.15.164:0/3833759140 conn(0x7f9a3c0ccf20 msgr2=0x7f9a3c14caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 shutdown_connections 2024-08-31T12:20:26.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.483+0000 7f9a44000640 1 -- 172.21.15.164:0/3833759140 wait complete. 2024-08-31T12:20:26.508 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-08-31T12:20:26.508 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-08-31T12:20:26.508 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:26.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 -- 172.21.15.164:0/4122887644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 msgr2=0x7fdcc4074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/4122887644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc4074720 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4072540 tx=0x7fdcbc01f580 comp rx=0 tx=0).stop 2024-08-31T12:20:26.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 -- 172.21.15.164:0/4122887644 shutdown_connections 2024-08-31T12:20:26.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/4122887644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc4074720 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/4122887644 >> v2:172.21.15.184:3300/0 conn(0x7fdcc415bc70 0x7fdcc4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 -- 172.21.15.164:0/4122887644 >> 172.21.15.164:0/4122887644 conn(0x7fdcc40ccf20 msgr2=0x7fdcc40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:26.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 -- 172.21.15.164:0/4122887644 shutdown_connections 2024-08-31T12:20:26.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 -- 172.21.15.164:0/4122887644 wait complete. 2024-08-31T12:20:26.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.659+0000 7fdcc9e00640 1 Processor -- start 2024-08-31T12:20:26.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- start start 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcc40c1f40 0x7fdcc415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcc415bc70 0x7fdcc414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc40c8030 con 0x7fdcc40c9330 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc40c3150 con 0x7fdcc415bc70 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc4074c60 con 0x7fdcc40c1f40 2024-08-31T12:20:26.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44118/0 (socket says 172.21.15.164:44118) 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 -- 172.21.15.164:0/2854659024 learned_addr learned my addr 172.21.15.164:0/2854659024 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2a00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcc40c1f40 0x7fdcc415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc3400640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcc415bc70 0x7fdcc414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 -- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcc40c1f40 msgr2=0x7fdcc415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcc40c1f40 0x7fdcc415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 -- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcc415bc70 msgr2=0x7fdcc414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcc415bc70 0x7fdcc414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 -- 172.21.15.164:0/2854659024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc4071d80 con 0x7fdcc40c9330 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc2000640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b440 tx=0x7fdcb000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0015020 con 0x7fdcc40c9330 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb0011980 con 0x7fdcc40c9330 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0011dd0 con 0x7fdcc40c9330 2024-08-31T12:20:26.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc415ac10 con 0x7fdcc40c9330 2024-08-31T12:20:26.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc40c6d20 con 0x7fdcc40c9330 2024-08-31T12:20:26.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.663+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc4074720 con 0x7fdcc40c9330 2024-08-31T12:20:26.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.667+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdcb0018020 con 0x7fdcc40c9330 2024-08-31T12:20:26.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.667+0000 7fdcbb400640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 0x7fdca4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:26.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.667+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fdcb0092d80 con 0x7fdcc40c9330 2024-08-31T12:20:26.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.667+0000 7fdcc2a00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 0x7fdca4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:26.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.667+0000 7fdcc2a00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 0x7fdca4074600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4004630 tx=0x7fdcb400b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:26.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.671+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdcb001f030 con 0x7fdcc40c9330 2024-08-31T12:20:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcc40699c0 con 0x7fdcc40c9330 2024-08-31T12:20:26.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcbb400640 1 -- 172.21.15.164:0/2854659024 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6056 (secure 0 0 0) 0x7fdcb000d040 con 0x7fdcc40c9330 2024-08-31T12:20:26.879 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:26.879 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":22,"btime":"2024-08-31T12:20:26:357254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:26.357250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:26.879 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 22 2024-08-31T12:20:26.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 msgr2=0x7fdca4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 0x7fdca4074600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4004630 tx=0x7fdcb400b2e0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 msgr2=0x7fdcc414b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.875+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b440 tx=0x7fdcb000b900 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 shutdown_connections 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdca40720f0 0x7fdca4074600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcc415bc70 0x7fdcc414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcc40c9330 0x7fdcc414b7b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 --2- 172.21.15.164:0/2854659024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcc40c1f40 0x7fdcc415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 >> 172.21.15.164:0/2854659024 conn(0x7fdcc40ccf20 msgr2=0x7fdcc40c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:26.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 shutdown_connections 2024-08-31T12:20:26.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:26.879+0000 7fdcc9e00640 1 -- 172.21.15.164:0/2854659024 wait complete. 2024-08-31T12:20:26.902 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:20:26:357254+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5125": { "addr": "172.21.15.184:6837/4233946054", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 4233946054, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 4233946054, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5125, "incarnation": 22, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 55, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:20:26.357250+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5125 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:20:28.903 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 -- 172.21.15.164:0/2531995584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 msgr2=0x7f59d00cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 --2- 172.21.15.164:0/2531995584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d00cf200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f59d00cfa30 tx=0x7f59c801c8c0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 -- 172.21.15.164:0/2531995584 shutdown_connections 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 --2- 172.21.15.164:0/2531995584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d00cf200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 --2- 172.21.15.164:0/2531995584 >> v2:172.21.15.184:3300/0 conn(0x7f59d0159f60 0x7f59d015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 --2- 172.21.15.164:0/2531995584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 0x7f59d0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 -- 172.21.15.164:0/2531995584 >> 172.21.15.164:0/2531995584 conn(0x7f59d0071be0 msgr2=0x7f59d006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 -- 172.21.15.164:0/2531995584 shutdown_connections 2024-08-31T12:20:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.063+0000 7f59d7600640 1 -- 172.21.15.164:0/2531995584 wait complete. 2024-08-31T12:20:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 Processor -- start 2024-08-31T12:20:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 -- start start 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 0x7f59d00cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 0x7f59d006df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01596f0 con 0x7f59d00cedf0 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01570b0 con 0x7f59d0159f60 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d7600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f59d00c5160 con 0x7f59d00c97e0 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44140/0 (socket says 172.21.15.164:44140) 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 -- 172.21.15.164:0/1097556102 learned_addr learned my addr 172.21.15.164:0/1097556102 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d4c00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 0x7f59d00cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d5600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 0x7f59d006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 -- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 msgr2=0x7f59d00cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 0x7f59d00cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 -- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 msgr2=0x7f59d006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 0x7f59d006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59cfe00640 1 -- 172.21.15.164:0/1097556102 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00cd800 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.067+0000 7f59d5600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 0x7f59d006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59cfe00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d680 tx=0x7f59bc00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc017070 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59bc004310 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d00ce5d0 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc009a80 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d01f5a60 con 0x7f59d00cedf0 2024-08-31T12:20:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d01f57d0 con 0x7f59d00cedf0 2024-08-31T12:20:29.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f59bc009c20 con 0x7f59d00cedf0 2024-08-31T12:20:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 0x7f59b00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.071+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f59bc092ee0 con 0x7f59d00cedf0 2024-08-31T12:20:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.075+0000 7f59d4c00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 0x7f59b00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.075+0000 7f59d4c00640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 0x7f59b00745d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e60 tx=0x7f59c00095b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.079+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f59bc05dd80 con 0x7f59d00cedf0 2024-08-31T12:20:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59d00c5d30 con 0x7f59d00cedf0 2024-08-31T12:20:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59ccc00640 1 -- 172.21.15.164:0/1097556102 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6056 (secure 0 0 0) 0x7f59bc062540 con 0x7f59d00cedf0 2024-08-31T12:20:29.279 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:29.279 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":22,"btime":"2024-08-31T12:20:26:357254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:26.357250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 22 2024-08-31T12:20:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 msgr2=0x7f59b00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 0x7f59b00745d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e60 tx=0x7f59c00095b0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 msgr2=0x7f59d014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d680 tx=0x7f59bc00db40 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 shutdown_connections 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f59b00720c0 0x7f59b00745d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59d0159f60 0x7f59d006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59d00cedf0 0x7f59d014f270 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 --2- 172.21.15.164:0/1097556102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59d00c97e0 0x7f59d00cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.275+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 >> 172.21.15.164:0/1097556102 conn(0x7f59d0071be0 msgr2=0x7f59d0149ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.279+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 shutdown_connections 2024-08-31T12:20:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:29.279+0000 7f59d7600640 1 -- 172.21.15.164:0/1097556102 wait complete. 2024-08-31T12:20:29.301 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:31.302 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- 172.21.15.164:0/4092006422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8003c90 msgr2=0x7fc8d80040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 --2- 172.21.15.164:0/4092006422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8003c90 0x7fc8d80040e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006f00 tx=0x7fc8e401ce80 comp rx=0 tx=0).stop 2024-08-31T12:20:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- 172.21.15.164:0/4092006422 shutdown_connections 2024-08-31T12:20:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 --2- 172.21.15.164:0/4092006422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8003c90 0x7fc8d80040e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- 172.21.15.164:0/4092006422 >> 172.21.15.164:0/4092006422 conn(0x7fc8f00ccf20 msgr2=0x7fc8f00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- 172.21.15.164:0/4092006422 shutdown_connections 2024-08-31T12:20:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- 172.21.15.164:0/4092006422 wait complete. 2024-08-31T12:20:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 Processor -- start 2024-08-31T12:20:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.479+0000 7fc8f8200640 1 -- start start 2024-08-31T12:20:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8d8003c90 0x7fc8f015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 0x7fc8f0153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f0152a10 con 0x7fc8f00cc450 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f00c3150 con 0x7fc8f00cc040 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f0152b90 con 0x7fc8d8003c90 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44154/0 (socket says 172.21.15.164:44154) 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f4e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 0x7fc8f0153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 -- 172.21.15.164:0/3404567472 learned_addr learned my addr 172.21.15.164:0/3404567472 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f5800640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8d8003c90 0x7fc8f015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 -- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8d8003c90 msgr2=0x7fc8f015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8d8003c90 0x7fc8f015a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 -- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 msgr2=0x7fc8f0153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 0x7fc8f0153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 -- 172.21.15.164:0/3404567472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f015a830 con 0x7fc8f00cc450 2024-08-31T12:20:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f4e00640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 0x7fc8f0153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:20:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f6200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00cadf0 tx=0x7fc8e800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8003b80 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e8003e10 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80062d0 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f00c5d50 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f00b2300 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.483+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f00c7920 con 0x7fc8f00cc450 2024-08-31T12:20:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.487+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc8e800d070 con 0x7fc8f00cc450 2024-08-31T12:20:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.487+0000 7fc8ed600640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 0x7fc8d00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.487+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fc8e80964b0 con 0x7fc8f00cc450 2024-08-31T12:20:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.487+0000 7fc8f5800640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 0x7fc8d00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.487+0000 7fc8f5800640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 0x7fc8d00745d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40ab000 tx=0x7fc8e4019cc0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:31.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.491+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc8e8061910 con 0x7fc8f00cc450 2024-08-31T12:20:31.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.695+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8f01560a0 con 0x7fc8f00cc450 2024-08-31T12:20:31.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.695+0000 7fc8ed600640 1 -- 172.21.15.164:0/3404567472 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6056 (secure 0 0 0) 0x7fc8e8061210 con 0x7fc8f00cc450 2024-08-31T12:20:31.700 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:31.700 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":22,"btime":"2024-08-31T12:20:26:357254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:26.357250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 22 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 msgr2=0x7fc8d00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 0x7fc8d00745d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40ab000 tx=0x7fc8e4019cc0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 msgr2=0x7fc8f014a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00cadf0 tx=0x7fc8e800e6b0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 shutdown_connections 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8d00720c0 0x7fc8d00745d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f00cc450 0x7fc8f014a7c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00cc040 0x7fc8f0153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 --2- 172.21.15.164:0/3404567472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8d8003c90 0x7fc8f015a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 >> 172.21.15.164:0/3404567472 conn(0x7fc8f00ccf20 msgr2=0x7fc8f014ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 shutdown_connections 2024-08-31T12:20:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:31.699+0000 7fc8f8200640 1 -- 172.21.15.164:0/3404567472 wait complete. 2024-08-31T12:20:31.721 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:33.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:33.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 -- 172.21.15.164:0/2984161848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3180c9330 msgr2=0x7fe318074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 --2- 172.21.15.164:0/2984161848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3180c9330 0x7fe318074720 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe310009c80 tx=0x7fe31001f5a0 comp rx=0 tx=0).stop 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 -- 172.21.15.164:0/2984161848 shutdown_connections 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 --2- 172.21.15.164:0/2984161848 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3180c9330 0x7fe318074720 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 --2- 172.21.15.164:0/2984161848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe31815bc70 0x7fe318152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 -- 172.21.15.164:0/2984161848 >> 172.21.15.164:0/2984161848 conn(0x7fe3180ccf20 msgr2=0x7fe3180cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 -- 172.21.15.164:0/2984161848 shutdown_connections 2024-08-31T12:20:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.883+0000 7fe31e600640 1 -- 172.21.15.164:0/2984161848 wait complete. 2024-08-31T12:20:33.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 Processor -- start 2024-08-31T12:20:33.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- start start 2024-08-31T12:20:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3180c1f40 0x7fe31814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 0x7fe3181e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180c8030 con 0x7fe31815bc70 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180c3150 con 0x7fe3180c9330 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe318074c60 con 0x7fe3180c1f40 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44182/0 (socket says 172.21.15.164:44182) 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 -- 172.21.15.164:0/2901096911 learned_addr learned my addr 172.21.15.164:0/2901096911 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317400640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3180c1f40 0x7fe31814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe30ea00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 0x7fe3181e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 -- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3180c1f40 msgr2=0x7fe31814da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3180c1f40 0x7fe31814da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 -- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 msgr2=0x7fe3181e1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 0x7fe3181e1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 -- 172.21.15.164:0/2901096911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181e3420 con 0x7fe31815bc70 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe30ea00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 0x7fe3181e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe317e00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe31001dc50 tx=0x7fe310009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004c50 con 0x7fe31815bc70 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3100af8a0 con 0x7fe31815bc70 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31814dfd0 con 0x7fe31815bc70 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100afcf0 con 0x7fe31815bc70 2024-08-31T12:20:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.887+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3181e2e60 con 0x7fe31815bc70 2024-08-31T12:20:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe318074720 con 0x7fe31815bc70 2024-08-31T12:20:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe310004000 con 0x7fe31815bc70 2024-08-31T12:20:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe30fe00640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 0x7fe2f40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fe3101318c0 con 0x7fe31815bc70 2024-08-31T12:20:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe317400640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 0x7fe2f40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.891+0000 7fe317400640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 0x7fe2f40745d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe308009b40 tx=0x7fe3080091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:33.895+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe3100ac050 con 0x7fe31815bc70 2024-08-31T12:20:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.095+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3180c82f0 con 0x7fe31815bc70 2024-08-31T12:20:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.095+0000 7fe30fe00640 1 -- 172.21.15.164:0/2901096911 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6060 (secure 0 0 0) 0x7fe310019100 con 0x7fe31815bc70 2024-08-31T12:20:34.099 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:34.099 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"btime":"2024-08-31T12:20:33:833133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:33.797703+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:34.100 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 msgr2=0x7fe2f40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 0x7fe2f40745d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe308009b40 tx=0x7fe3080091e0 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 msgr2=0x7fe3181e49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe31001dc50 tx=0x7fe310009350 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 shutdown_connections 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2f40720c0 0x7fe2f40745d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe31815bc70 0x7fe3181e49f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3180c9330 0x7fe3181e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 --2- 172.21.15.164:0/2901096911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3180c1f40 0x7fe31814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 >> 172.21.15.164:0/2901096911 conn(0x7fe3180ccf20 msgr2=0x7fe3180c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 shutdown_connections 2024-08-31T12:20:34.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:34.099+0000 7fe31e600640 1 -- 172.21.15.164:0/2901096911 wait complete. 2024-08-31T12:20:34.121 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:35.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:20:35.384 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:20:36.123 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 -- 172.21.15.164:0/1216770184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 msgr2=0x7f8dcc152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 --2- 172.21.15.164:0/1216770184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc152a10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc073280 tx=0x7f8dbc01eff0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 -- 172.21.15.164:0/1216770184 shutdown_connections 2024-08-31T12:20:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 --2- 172.21.15.164:0/1216770184 >> v2:172.21.15.184:3300/0 conn(0x7f8dcc0c9330 0x7f8dcc074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 --2- 172.21.15.164:0/1216770184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc152a10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 -- 172.21.15.164:0/1216770184 >> 172.21.15.164:0/1216770184 conn(0x7f8dcc0ccf20 msgr2=0x7f8dcc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 -- 172.21.15.164:0/1216770184 shutdown_connections 2024-08-31T12:20:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.271+0000 7f8dd1600640 1 -- 172.21.15.164:0/1216770184 wait complete. 2024-08-31T12:20:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 Processor -- start 2024-08-31T12:20:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- start start 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dcc0c1f40 0x7f8dcc1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 0x7f8dcc156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0c8030 con 0x7f8dcc15bc70 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0c3150 con 0x7f8dcc0c1f40 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc074c60 con 0x7f8dcc0c9330 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59234/0 (socket says 172.21.15.164:59234) 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 -- 172.21.15.164:0/2926111072 learned_addr learned my addr 172.21.15.164:0/2926111072 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcaa00640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dcc0c1f40 0x7f8dcc1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dc2000640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 0x7f8dcc156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 -- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 msgr2=0x7f8dcc156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 0x7f8dcc156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 -- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dcc0c1f40 msgr2=0x7f8dcc1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dcc0c1f40 0x7f8dcc1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 -- 172.21.15.164:0/2926111072 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc1f1d30 con 0x7f8dcc15bc70 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dc2000640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 0x7f8dcc156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dcb400640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400e940 tx=0x7f8dc400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4004d30 con 0x7f8dcc15bc70 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc400cb20 con 0x7f8dcc15bc70 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4005020 con 0x7f8dcc15bc70 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dcc1f2720 con 0x7f8dcc15bc70 2024-08-31T12:20:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.275+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dcc1f56d0 con 0x7f8dcc15bc70 2024-08-31T12:20:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.279+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dcc074720 con 0x7f8dcc15bc70 2024-08-31T12:20:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.279+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8dc40051c0 con 0x7f8dcc15bc70 2024-08-31T12:20:36.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.279+0000 7f8dc3400640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 0x7f8da8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:36.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.279+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f8dc4093800 con 0x7f8dcc15bc70 2024-08-31T12:20:36.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.283+0000 7f8dcaa00640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 0x7f8da8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:36.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.283+0000 7f8dcaa00640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 0x7f8da8074600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0b2000 tx=0x7f8dbc01d830 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:36.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.287+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8dc4016030 con 0x7f8dcc15bc70 2024-08-31T12:20:36.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dcc1560a0 con 0x7f8dcc15bc70 2024-08-31T12:20:36.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dc3400640 1 -- 172.21.15.164:0/2926111072 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6060 (secure 0 0 0) 0x7f8dc4067110 con 0x7f8dcc15bc70 2024-08-31T12:20:36.487 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:36.487 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"btime":"2024-08-31T12:20:33:833133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:33.797703+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:36.487 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-08-31T12:20:36.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 msgr2=0x7f8da8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:36.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 0x7f8da8074600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0b2000 tx=0x7f8dbc01d830 comp rx=0 tx=0).stop 2024-08-31T12:20:36.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 msgr2=0x7f8dcc157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400e940 tx=0x7f8dc400ee00 comp rx=0 tx=0).stop 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 shutdown_connections 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8da80720f0 0x7f8da8074600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dcc15bc70 0x7f8dcc157c20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dcc0c9330 0x7f8dcc156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 --2- 172.21.15.164:0/2926111072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dcc0c1f40 0x7f8dcc1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 >> 172.21.15.164:0/2926111072 conn(0x7f8dcc0ccf20 msgr2=0x7f8dcc151820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 shutdown_connections 2024-08-31T12:20:36.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:36.483+0000 7f8dd1600640 1 -- 172.21.15.164:0/2926111072 wait complete. 2024-08-31T12:20:36.509 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:38.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:38.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 -- 172.21.15.164:0/3983218307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 msgr2=0x7f922c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:38.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 --2- 172.21.15.164:0/3983218307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c1536f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f922c0cc880 tx=0x7f921801f0b0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 -- 172.21.15.164:0/3983218307 shutdown_connections 2024-08-31T12:20:38.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 --2- 172.21.15.164:0/3983218307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c1536f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 --2- 172.21.15.164:0/3983218307 >> v2:172.21.15.184:3300/0 conn(0x7f922c0ca930 0x7f922c0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 -- 172.21.15.164:0/3983218307 >> 172.21.15.164:0/3983218307 conn(0x7f922c06cc30 msgr2=0x7f922c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:38.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 -- 172.21.15.164:0/3983218307 shutdown_connections 2024-08-31T12:20:38.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.671+0000 7f922be00640 1 -- 172.21.15.164:0/3983218307 wait complete. 2024-08-31T12:20:38.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 Processor -- start 2024-08-31T12:20:38.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- start start 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c0ca930 0x7f922c1f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c15d9f0 0x7f922c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f922c15d4d0 con 0x7f922c0ca0e0 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f922c15d1f0 con 0x7f922c15d9f0 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f922c0b1c90 con 0x7f922c0ca930 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59268/0 (socket says 172.21.15.164:59268) 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 -- 172.21.15.164:0/1980476502 learned_addr learned my addr 172.21.15.164:0/1980476502 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922a000640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c0ca930 0x7f922c1f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:38.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922b400640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c15d9f0 0x7f922c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 -- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c0ca930 msgr2=0x7f922c1f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c0ca930 0x7f922c1f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 -- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c15d9f0 msgr2=0x7f922c1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c15d9f0 0x7f922c1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 -- 172.21.15.164:0/1980476502 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c1f1a50 con 0x7f922c0ca0e0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922aa00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f921c00d750 tx=0x7f921c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c017070 con 0x7f922c0ca0e0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f921c009d20 con 0x7f922c0ca0e0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c005280 con 0x7f922c0ca0e0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c1f5e20 con 0x7f922c0ca0e0 2024-08-31T12:20:38.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.675+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c0b4ef0 con 0x7f922c0ca0e0 2024-08-31T12:20:38.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.679+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c0ca540 con 0x7f922c0ca0e0 2024-08-31T12:20:38.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.679+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f921c005420 con 0x7f922c0ca0e0 2024-08-31T12:20:38.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.679+0000 7f9223400640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 0x7f920c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:38.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.679+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f921c093280 con 0x7f922c0ca0e0 2024-08-31T12:20:38.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.679+0000 7f922a000640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 0x7f920c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:38.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.683+0000 7f922a000640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 0x7f920c0745d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92180b2000 tx=0x7f921801d8f0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:38.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.683+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f921c00de60 con 0x7f922c0ca0e0 2024-08-31T12:20:38.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f922c1570a0 con 0x7f922c0ca0e0 2024-08-31T12:20:38.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f9223400640 1 -- 172.21.15.164:0/1980476502 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6060 (secure 0 0 0) 0x7f921c05e650 con 0x7f922c0ca0e0 2024-08-31T12:20:38.895 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:38.895 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"btime":"2024-08-31T12:20:33:833133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:33.797703+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:38.895 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 msgr2=0x7f920c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 0x7f920c0745d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92180b2000 tx=0x7f921801d8f0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 msgr2=0x7f922c14db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f921c00d750 tx=0x7f921c00dc10 comp rx=0 tx=0).stop 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 shutdown_connections 2024-08-31T12:20:38.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f920c0720c0 0x7f920c0745d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c15d9f0 0x7f922c1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c0ca930 0x7f922c1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 --2- 172.21.15.164:0/1980476502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f922c0ca0e0 0x7f922c14db10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 >> 172.21.15.164:0/1980476502 conn(0x7f922c06cc30 msgr2=0x7f922c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 shutdown_connections 2024-08-31T12:20:38.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:38.891+0000 7f922be00640 1 -- 172.21.15.164:0/1980476502 wait complete. 2024-08-31T12:20:38.918 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:20:33:833133+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5125": { "addr": "172.21.15.184:6837/4233946054", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 4233946054, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 4233946054, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5125, "incarnation": 22, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:reconnect", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 55, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:20:33.797703+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5125 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:20:40.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:41.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- 172.21.15.164:0/797996860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc59015bc70 msgr2=0x7fc590152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:41.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 --2- 172.21.15.164:0/797996860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc59015bc70 0x7fc590152a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc580009900 tx=0x7fc58001f0d0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- 172.21.15.164:0/797996860 shutdown_connections 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 --2- 172.21.15.164:0/797996860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 0x7fc590074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 --2- 172.21.15.164:0/797996860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc59015bc70 0x7fc590152a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- 172.21.15.164:0/797996860 >> 172.21.15.164:0/797996860 conn(0x7fc5900ccf20 msgr2=0x7fc5900cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- 172.21.15.164:0/797996860 shutdown_connections 2024-08-31T12:20:41.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- 172.21.15.164:0/797996860 wait complete. 2024-08-31T12:20:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 Processor -- start 2024-08-31T12:20:41.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.083+0000 7fc594e00640 1 -- start start 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 0x7fc5900c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59015bc70 0x7fc59014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900c8030 con 0x7fc5900c1f40 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900c3150 con 0x7fc59015bc70 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc590074c60 con 0x7fc5900c9330 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59284/0 (socket says 172.21.15.164:59284) 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 -- 172.21.15.164:0/4032826477 learned_addr learned my addr 172.21.15.164:0/4032826477 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:41.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc585400640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 0x7fc5900c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58e800640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59015bc70 0x7fc59014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 -- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 msgr2=0x7fc5900c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 0x7fc5900c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 -- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59015bc70 msgr2=0x7fc59014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59015bc70 0x7fc59014ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 -- 172.21.15.164:0/4032826477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc590074a30 con 0x7fc5900c1f40 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc58de00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b3040 tx=0x7fc580005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800be070 con 0x7fc5900c1f40 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5800b08e0 con 0x7fc5900c1f40 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b5040 con 0x7fc5900c1f40 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5901f2d00 con 0x7fc5900c1f40 2024-08-31T12:20:41.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5901f1fe0 con 0x7fc5900c1f40 2024-08-31T12:20:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.087+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc590074720 con 0x7fc5900c1f40 2024-08-31T12:20:41.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.091+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc5800b0cf0 con 0x7fc5900c1f40 2024-08-31T12:20:41.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.091+0000 7fc586a00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 0x7fc56c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:41.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.091+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fc58012ffa0 con 0x7fc5900c1f40 2024-08-31T12:20:41.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.091+0000 7fc585400640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 0x7fc56c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:41.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.091+0000 7fc585400640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 0x7fc56c0745d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc590152170 tx=0x7fc578009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:41.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.095+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc580018c30 con 0x7fc5900c1f40 2024-08-31T12:20:41.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.291+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5901560a0 con 0x7fc5900c1f40 2024-08-31T12:20:41.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc586a00640 1 -- 172.21.15.164:0/4032826477 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6057 (secure 0 0 0) 0x7fc5800fb490 con 0x7fc5900c1f40 2024-08-31T12:20:41.297 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"btime":"2024-08-31T12:20:39:808531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:38.839297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:41.298 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 msgr2=0x7fc56c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 0x7fc56c0745d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc590152170 tx=0x7fc578009040 comp rx=0 tx=0).stop 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 msgr2=0x7fc5901f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b3040 tx=0x7fc580005de0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 shutdown_connections 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc56c0720c0 0x7fc56c0745d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59015bc70 0x7fc59014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5900c9330 0x7fc5900c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 --2- 172.21.15.164:0/4032826477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5900c1f40 0x7fc5901f27c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:41.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 >> 172.21.15.164:0/4032826477 conn(0x7fc5900ccf20 msgr2=0x7fc590070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:41.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 shutdown_connections 2024-08-31T12:20:41.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:41.295+0000 7fc594e00640 1 -- 172.21.15.164:0/4032826477 wait complete. 2024-08-31T12:20:41.319 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:43.320 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 -- 172.21.15.164:0/2726663631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 msgr2=0x7f8da40c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 --2- 172.21.15.164:0/2726663631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da40c9330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009bc0 tx=0x7f8d9c01f3b0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 -- 172.21.15.164:0/2726663631 shutdown_connections 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 --2- 172.21.15.164:0/2726663631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da40c9330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 -- 172.21.15.164:0/2726663631 >> 172.21.15.164:0/2726663631 conn(0x7f8da40ccf20 msgr2=0x7f8da40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 -- 172.21.15.164:0/2726663631 shutdown_connections 2024-08-31T12:20:43.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.479+0000 7f8da8e00640 1 -- 172.21.15.164:0/2726663631 wait complete. 2024-08-31T12:20:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 Processor -- start 2024-08-31T12:20:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- start start 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8da40c1f40 0x7f8da4153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da415bc70 0x7f8da4154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4074e30 con 0x7f8da4152a10 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8da40c8030 con 0x7f8da415bc70 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8da4074fb0 con 0x7f8da40c1f40 2024-08-31T12:20:43.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59308/0 (socket says 172.21.15.164:59308) 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 -- 172.21.15.164:0/4001150666 learned_addr learned my addr 172.21.15.164:0/4001150666 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da2800640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da415bc70 0x7f8da4154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da1e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8da40c1f40 0x7f8da4153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 -- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8da40c1f40 msgr2=0x7f8da4153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8da40c1f40 0x7f8da4153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 -- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da415bc70 msgr2=0x7f8da4154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da415bc70 0x7f8da4154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 -- 172.21.15.164:0/4001150666 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da41508d0 con 0x7f8da4152a10 2024-08-31T12:20:43.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d99400640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00c3f0 tx=0x7f8d8c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c017070 con 0x7f8da4152a10 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d8c003600 con 0x7f8da4152a10 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c003a50 con 0x7f8da4152a10 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da4153f50 con 0x7f8da4152a10 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.483+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da40c5f30 con 0x7f8da4152a10 2024-08-31T12:20:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.487+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da40c9330 con 0x7f8da4152a10 2024-08-31T12:20:43.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.487+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8d8c01a070 con 0x7f8da4152a10 2024-08-31T12:20:43.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.487+0000 7f8d9aa00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 0x7f8d800745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:43.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.487+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f8d8c0921a0 con 0x7f8da4152a10 2024-08-31T12:20:43.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.487+0000 7f8da1e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 0x7f8d800745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:43.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.491+0000 7f8da1e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 0x7f8d800745d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d94009060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.491+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8da41508d0 con 0x7f8da4152a10 2024-08-31T12:20:43.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da40c82f0 con 0x7f8da4152a10 2024-08-31T12:20:43.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8d9aa00640 1 -- 172.21.15.164:0/4001150666 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6057 (secure 0 0 0) 0x7f8d8c05d040 con 0x7f8da4152a10 2024-08-31T12:20:43.699 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:43.699 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"btime":"2024-08-31T12:20:39:808531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:38.839297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:20:43.699 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-08-31T12:20:43.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 msgr2=0x7f8d800745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:43.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 0x7f8d800745d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d94009060 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 msgr2=0x7f8da41557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00c3f0 tx=0x7f8d8c00c8b0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 shutdown_connections 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.695+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8d800720c0 0x7f8d800745d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da415bc70 0x7f8da4154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8da4152a10 0x7f8da41557e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 --2- 172.21.15.164:0/4001150666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8da40c1f40 0x7f8da4153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 >> 172.21.15.164:0/4001150666 conn(0x7f8da40ccf20 msgr2=0x7f8da4071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 shutdown_connections 2024-08-31T12:20:43.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:43.699+0000 7f8da8e00640 1 -- 172.21.15.164:0/4001150666 wait complete. 2024-08-31T12:20:43.721 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:20:45.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 -- 172.21.15.164:0/2239084723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540c4760 msgr2=0x7faf540c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 --2- 172.21.15.164:0/2239084723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540c4760 0x7faf540c3f70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faf5415a9c0 tx=0x7faf4401c8c0 comp rx=0 tx=0).stop 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 -- 172.21.15.164:0/2239084723 shutdown_connections 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 --2- 172.21.15.164:0/2239084723 >> v2:172.21.15.184:3300/0 conn(0x7faf54159a70 0x7faf54159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 --2- 172.21.15.164:0/2239084723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540c4760 0x7faf540c3f70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 -- 172.21.15.164:0/2239084723 >> 172.21.15.164:0/2239084723 conn(0x7faf540717b0 msgr2=0x7faf54071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 -- 172.21.15.164:0/2239084723 shutdown_connections 2024-08-31T12:20:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.883+0000 7faf59200640 1 -- 172.21.15.164:0/2239084723 wait complete. 2024-08-31T12:20:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 Processor -- start 2024-08-31T12:20:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 -- start start 2024-08-31T12:20:45.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf540c4760 0x7faf5414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:45.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:45.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 0x7faf5414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf540b2aa0 con 0x7faf540ca930 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faf540b2c20 con 0x7faf540c4760 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf59200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faf54153d60 con 0x7faf54159a70 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45094/0 (socket says 172.21.15.164:45094) 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 -- 172.21.15.164:0/2122440777 learned_addr learned my addr 172.21.15.164:0/2122440777 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf51e00640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf540c4760 0x7faf5414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf52800640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 0x7faf5414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 -- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 msgr2=0x7faf5414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 0x7faf5414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 -- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf540c4760 msgr2=0x7faf5414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf540c4760 0x7faf5414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:45.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf49400640 1 -- 172.21.15.164:0/2122440777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5406e280 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.887+0000 7faf52800640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 0x7faf5414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf49400640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c450 tx=0x7faf3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0052d0 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf3c005470 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c012870 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf54162d80 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf54141df0 con 0x7faf540ca930 2024-08-31T12:20:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf540caed0 con 0x7faf540ca930 2024-08-31T12:20:45.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7faf3c003600 con 0x7faf540ca930 2024-08-31T12:20:45.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 0x7faf300745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:45.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7faf3c0929d0 con 0x7faf540ca930 2024-08-31T12:20:45.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.891+0000 7faf51e00640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 0x7faf300745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.895+0000 7faf51e00640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 0x7faf300745d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf440af000 tx=0x7faf440a7040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:45.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:45.895+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7faf3c05dec0 con 0x7faf540ca930 2024-08-31T12:20:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.091+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf5414fad0 con 0x7faf540ca930 2024-08-31T12:20:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf4aa00640 1 -- 172.21.15.164:0/2122440777 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6064 (secure 0 0 0) 0x7faf3c066370 con 0x7faf540ca930 2024-08-31T12:20:46.097 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:46.098 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":25,"btime":"2024-08-31T12:20:45:857958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:20:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 25 2024-08-31T12:20:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 msgr2=0x7faf300745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 0x7faf300745d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf440af000 tx=0x7faf440a7040 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 msgr2=0x7faf5406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c450 tx=0x7faf3c00c910 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 shutdown_connections 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faf300720c0 0x7faf300745d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf54159a70 0x7faf5414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf540ca930 0x7faf5406dd40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 --2- 172.21.15.164:0/2122440777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf540c4760 0x7faf5414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 >> 172.21.15.164:0/2122440777 conn(0x7faf540717b0 msgr2=0x7faf540c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 shutdown_connections 2024-08-31T12:20:46.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:46.095+0000 7faf59200640 1 -- 172.21.15.164:0/2122440777 wait complete. 2024-08-31T12:20:46.119 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4992 2024-08-31T12:20:46.120 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 7 secs before reviving mds.a 2024-08-31T12:20:51.127 INFO:tasks.workunit.client.0.smithi164.stderr:error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. 2024-08-31T12:20:51.127 INFO:tasks.workunit.client.0.smithi164.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2024-08-31T12:20:51.127 INFO:tasks.workunit.client.0.smithi164.stderr:fatal: early EOF 2024-08-31T12:20:51.134 INFO:tasks.workunit.client.0.smithi164.stderr:fatal: fetch-pack: invalid index-pack output 2024-08-31T12:20:52.065 INFO:tasks.workunit.client.0.smithi164.stderr:+ retry 2024-08-31T12:20:52.065 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm -rf ceph 2024-08-31T12:20:52.066 INFO:tasks.workunit.client.0.smithi164.stderr:+ timeout 3600 git clone https://git.ceph.com/ceph.git 2024-08-31T12:20:52.071 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into 'ceph'... 2024-08-31T12:20:53.121 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-08-31T12:20:53.121 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-31T12:20:53.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-31T12:20:53.125 INFO:tasks.ceph.mds.a:Started 2024-08-31T12:20:53.125 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:53.225 INFO:tasks.ceph.mds.a.smithi164.stdout:starting mds.a at 2024-08-31T12:20:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 -- 172.21.15.164:0/3434284802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe480003fe0 msgr2=0x7fe480004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/3434284802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe480003fe0 0x7fe480004810 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe484009b10 tx=0x7fe48401d210 comp rx=0 tx=0).stop 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe49a800640 1 -- 172.21.15.164:0/3434284802 reap_dead start 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 -- 172.21.15.164:0/3434284802 shutdown_connections 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 -- 172.21.15.164:0/3434284802 >> 172.21.15.164:0/3434284802 conn(0x7fe49c073630 msgr2=0x7fe49c073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 -- 172.21.15.164:0/3434284802 shutdown_connections 2024-08-31T12:20:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.279+0000 7fe4a0c00640 1 -- 172.21.15.164:0/3434284802 wait complete. 2024-08-31T12:20:53.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 Processor -- start 2024-08-31T12:20:53.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- start start 2024-08-31T12:20:53.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 0x7fe49c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:53.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe49c149ae0 0x7fe49c149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c0c3fe0 con 0x7fe49c15bee0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c0c99c0 con 0x7fe480003fe0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe49c15b060 con 0x7fe49c149ae0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45114/0 (socket says 172.21.15.164:45114) 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 -- 172.21.15.164:0/2473944468 learned_addr learned my addr 172.21.15.164:0/2473944468 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe49a800640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe49c149ae0 0x7fe49c149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe499e00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 0x7fe49c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 -- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe49c149ae0 msgr2=0x7fe49c149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe49c149ae0 0x7fe49c149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 -- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 msgr2=0x7fe49c1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:53.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 0x7fe49c1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 -- 172.21.15.164:0/2473944468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c15a2a0 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe499e00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 0x7fe49c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe491400640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ae040 tx=0x7fe4840050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840bb030 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe484004a50 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c15a580 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484004e80 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.283+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c15d040 con 0x7fe49c15bee0 2024-08-31T12:20:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.287+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c0ca460 con 0x7fe49c15bee0 2024-08-31T12:20:53.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.287+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe4840be030 con 0x7fe49c15bee0 2024-08-31T12:20:53.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.287+0000 7fe492a00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 0x7fe4780745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:53.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.287+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fe48412e7a0 con 0x7fe49c15bee0 2024-08-31T12:20:53.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.287+0000 7fe499e00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 0x7fe4780745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:53.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.291+0000 7fe499e00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 0x7fe4780745d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001870 tx=0x7fe48c001cc0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:53.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.291+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe484016f60 con 0x7fe49c15bee0 2024-08-31T12:20:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe49c0b4fb0 con 0x7fe49c15bee0 2024-08-31T12:20:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe492a00640 1 -- 172.21.15.164:0/2473944468 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6064 (secure 0 0 0) 0x7fe4840f9c30 con 0x7fe49c15bee0 2024-08-31T12:20:53.499 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:53.499 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":25,"btime":"2024-08-31T12:20:45:857958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:20:53.499 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 25 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 msgr2=0x7fe4780745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 0x7fe4780745d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001870 tx=0x7fe48c001cc0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 msgr2=0x7fe49c1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ae040 tx=0x7fe4840050b0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 shutdown_connections 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe4780720c0 0x7fe4780745d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe49c149ae0 0x7fe49c149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe49c15bee0 0x7fe49c1500d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 --2- 172.21.15.164:0/2473944468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480003fe0 0x7fe49c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 >> 172.21.15.164:0/2473944468 conn(0x7fe49c073630 msgr2=0x7fe49c0ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 shutdown_connections 2024-08-31T12:20:53.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:53.495+0000 7fe4a0c00640 1 -- 172.21.15.164:0/2473944468 wait complete. 2024-08-31T12:20:53.521 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-08-31T12:20:54.819 INFO:tasks.ceph.mds.d.smithi184.stderr:2024-08-31T12:20:54.820+0000 7f52f52ef640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:20:55.522 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 -- 172.21.15.164:0/2187916816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e8004010 msgr2=0x7fe2e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 --2- 172.21.15.164:0/2187916816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e8004010 0x7fe2e8004810 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe3040c25b0 tx=0x7fe2f001d1b0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe309400640 1 -- 172.21.15.164:0/2187916816 reap_dead start 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 -- 172.21.15.164:0/2187916816 shutdown_connections 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 -- 172.21.15.164:0/2187916816 >> 172.21.15.164:0/2187916816 conn(0x7fe3040ccf20 msgr2=0x7fe3040cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 -- 172.21.15.164:0/2187916816 shutdown_connections 2024-08-31T12:20:55.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.675+0000 7fe30b400640 1 -- 172.21.15.164:0/2187916816 wait complete. 2024-08-31T12:20:55.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 Processor -- start 2024-08-31T12:20:55.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- start start 2024-08-31T12:20:55.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e8004010 0x7fe3041e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:55.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3041572b0 0x7fe3041f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040c8030 con 0x7fe304070fb0 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040c3150 con 0x7fe2e8004010 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe304074e30 con 0x7fe3041572b0 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44226/0 (socket says 172.21.15.164:44226) 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 -- 172.21.15.164:0/2386147947 learned_addr learned my addr 172.21.15.164:0/2386147947 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe303e00640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3041572b0 0x7fe3041f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe308a00640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e8004010 0x7fe3041e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:55.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 -- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3041572b0 msgr2=0x7fe3041f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3041572b0 0x7fe3041f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 -- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e8004010 msgr2=0x7fe3041e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e8004010 0x7fe3041e1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 -- 172.21.15.164:0/2386147947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3041f2060 con 0x7fe304070fb0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe309400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006fd0 tx=0x7fe2fc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc011630 con 0x7fe304070fb0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2fc018070 con 0x7fe304070fb0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc011a70 con 0x7fe304070fb0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3041e4ab0 con 0x7fe304070fb0 2024-08-31T12:20:55.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.679+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3041f56c0 con 0x7fe304070fb0 2024-08-31T12:20:55.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304152a10 con 0x7fe304070fb0 2024-08-31T12:20:55.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe2fc011c10 con 0x7fe304070fb0 2024-08-31T12:20:55.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe300c00640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 0x7fe2e40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:20:55.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fe2fc093670 con 0x7fe304070fb0 2024-08-31T12:20:55.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe308a00640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 0x7fe2e40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:20:55.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.683+0000 7fe308a00640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 0x7fe2e40745d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4001ac0 tx=0x7fe2f4006b30 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:20:55.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.687+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe2fc05ead0 con 0x7fe304070fb0 2024-08-31T12:20:55.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.887+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3041560a0 con 0x7fe304070fb0 2024-08-31T12:20:55.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe300c00640 1 -- 172.21.15.164:0/2386147947 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7fe2fc05e3d0 con 0x7fe304070fb0 2024-08-31T12:20:55.894 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:20:55.894 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:20:55.894 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:20:55.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 msgr2=0x7fe2e40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:55.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 0x7fe2e40745d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4001ac0 tx=0x7fe2f4006b30 comp rx=0 tx=0).stop 2024-08-31T12:20:55.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 msgr2=0x7fe3040713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:20:55.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006fd0 tx=0x7fe2fc001640 comp rx=0 tx=0).stop 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 shutdown_connections 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe2e40720c0 0x7fe2e40745d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe304070fb0 0x7fe3040713c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3041572b0 0x7fe3041f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 --2- 172.21.15.164:0/2386147947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e8004010 0x7fe3041e1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 >> 172.21.15.164:0/2386147947 conn(0x7fe3040ccf20 msgr2=0x7fe3040c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 shutdown_connections 2024-08-31T12:20:55.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:20:55.891+0000 7fe30b400640 1 -- 172.21.15.164:0/2386147947 wait complete. 2024-08-31T12:20:55.916 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-08-31T12:20:55.916 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 7 secs before thrashing 2024-08-31T12:21:02.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:03.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 -- 172.21.15.164:0/1821651682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380caef0 msgr2=0x7f8a38159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 --2- 172.21.15.164:0/1821651682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380caef0 0x7f8a38159900 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8a380cf080 tx=0x7f8a3001f580 comp rx=0 tx=0).stop 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 -- 172.21.15.164:0/1821651682 shutdown_connections 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 --2- 172.21.15.164:0/1821651682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380caef0 0x7f8a38159900 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 --2- 172.21.15.164:0/1821651682 >> v2:172.21.15.184:3300/0 conn(0x7f8a3806d060 0x7f8a3806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 -- 172.21.15.164:0/1821651682 >> 172.21.15.164:0/1821651682 conn(0x7f8a38070bc0 msgr2=0x7f8a38074690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 -- 172.21.15.164:0/1821651682 shutdown_connections 2024-08-31T12:21:03.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.079+0000 7f8a40000640 1 -- 172.21.15.164:0/1821651682 wait complete. 2024-08-31T12:21:03.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 Processor -- start 2024-08-31T12:21:03.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- start start 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806d060 0x7f8a38155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a380c4250 0x7f8a38149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a380cb540 con 0x7f8a381537a0 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8a380cb3c0 con 0x7f8a3806d060 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8a38153bb0 con 0x7f8a380c4250 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44250/0 (socket says 172.21.15.164:44250) 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 -- 172.21.15.164:0/2761517468 learned_addr learned my addr 172.21.15.164:0/2761517468 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3d600640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806d060 0x7f8a38155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3e000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a380c4250 0x7f8a38149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 -- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a380c4250 msgr2=0x7f8a38149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a380c4250 0x7f8a38149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 -- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806d060 msgr2=0x7f8a38155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806d060 0x7f8a38155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 -- 172.21.15.164:0/2761517468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38155c40 con 0x7f8a381537a0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a3cc00640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c450 tx=0x7f8a2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240052d0 con 0x7f8a381537a0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a24005470 con 0x7f8a381537a0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a381f1760 con 0x7f8a381537a0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24012870 con 0x7f8a381537a0 2024-08-31T12:21:03.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.083+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a381f1d20 con 0x7f8a381537a0 2024-08-31T12:21:03.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.087+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3806d680 con 0x7f8a381537a0 2024-08-31T12:21:03.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.087+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8a24003600 con 0x7f8a381537a0 2024-08-31T12:21:03.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.087+0000 7f8a35600640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 0x7f8a180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.087+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f8a24092b10 con 0x7f8a381537a0 2024-08-31T12:21:03.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.087+0000 7f8a3d600640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 0x7f8a180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.091+0000 7f8a3d600640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 0x7f8a180745d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c005fd0 tx=0x7f8a2c005e40 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:03.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.091+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8a2405df70 con 0x7f8a381537a0 2024-08-31T12:21:03.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.295+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a380729c0 con 0x7f8a381537a0 2024-08-31T12:21:03.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a35600640 1 -- 172.21.15.164:0/2761517468 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7f8a24066420 con 0x7f8a381537a0 2024-08-31T12:21:03.302 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:03.302 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:03.302 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 msgr2=0x7f8a180745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 0x7f8a180745d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c005fd0 tx=0x7f8a2c005e40 comp rx=0 tx=0).stop 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 msgr2=0x7f8a38154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c450 tx=0x7f8a2400c910 comp rx=0 tx=0).stop 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 shutdown_connections 2024-08-31T12:21:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8a180720c0 0x7f8a180745d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a380c4250 0x7f8a38149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a381537a0 0x7f8a38154c40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 --2- 172.21.15.164:0/2761517468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806d060 0x7f8a38155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 >> 172.21.15.164:0/2761517468 conn(0x7f8a38070bc0 msgr2=0x7f8a38152240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 shutdown_connections 2024-08-31T12:21:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.299+0000 7f8a40000640 1 -- 172.21.15.164:0/2761517468 wait complete. 2024-08-31T12:21:03.323 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-08-31T12:21:03.324 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-31T12:21:03.324 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:21:03.346 INFO:tasks.ceph.mds.d:Stopped 2024-08-31T12:21:03.346 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 -- 172.21.15.164:0/649927440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 msgr2=0x7f4230165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 --2- 172.21.15.164:0/649927440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f4230165080 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4228009bc0 tx=0x7f422801cac0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 -- 172.21.15.164:0/649927440 shutdown_connections 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 --2- 172.21.15.164:0/649927440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f4230165080 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 -- 172.21.15.164:0/649927440 >> 172.21.15.164:0/649927440 conn(0x7f4230071be0 msgr2=0x7f423006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:03.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 -- 172.21.15.164:0/649927440 shutdown_connections 2024-08-31T12:21:03.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.495+0000 7f4236200640 1 -- 172.21.15.164:0/649927440 wait complete. 2024-08-31T12:21:03.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 Processor -- start 2024-08-31T12:21:03.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 -- start start 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 0x7f4230153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 0x7f4230164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f42301596f0 con 0x7f423015a370 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4230159ad0 con 0x7f4230159f60 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f4236200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f42300c5160 con 0x7f42300c97e0 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f422fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f422fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44278/0 (socket says 172.21.15.164:44278) 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f422fe00640 1 -- 172.21.15.164:0/3087602942 learned_addr learned my addr 172.21.15.164:0/3087602942 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f422ea00640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 0x7f4230164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.499+0000 7f422f400640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 0x7f4230153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 -- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 msgr2=0x7f4230153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 0x7f4230153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 -- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 msgr2=0x7f4230164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 0x7f4230164d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 -- 172.21.15.164:0/3087602942 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42300ce810 con 0x7f423015a370 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422ea00640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 0x7f4230164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422f400640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 0x7f4230153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f422fe00640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f42280196d0 tx=0x7f4228005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280b2040 con 0x7f423015a370 2024-08-31T12:21:03.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4228003b30 con 0x7f423015a370 2024-08-31T12:21:03.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228004040 con 0x7f423015a370 2024-08-31T12:21:03.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42300ced60 con 0x7f423015a370 2024-08-31T12:21:03.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42301f9030 con 0x7f423015a370 2024-08-31T12:21:03.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42300c5e70 con 0x7f423015a370 2024-08-31T12:21:03.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.503+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f42280bd030 con 0x7f423015a370 2024-08-31T12:21:03.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.507+0000 7f4227400640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 0x7f42100745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:03.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.507+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f422812cb10 con 0x7f423015a370 2024-08-31T12:21:03.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.507+0000 7f422f400640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 0x7f42100745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:03.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.507+0000 7f422f400640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 0x7f42100745d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4220001230 tx=0x7f4220009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:03.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.511+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f42280c4060 con 0x7f423015a370 2024-08-31T12:21:03.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.707+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4230156150 con 0x7f423015a370 2024-08-31T12:21:03.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.707+0000 7f4227400640 1 -- 172.21.15.164:0/3087602942 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7f42280166b0 con 0x7f423015a370 2024-08-31T12:21:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:03.712 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:03.712 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 msgr2=0x7f42100745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 0x7f42100745d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4220001230 tx=0x7f4220009040 comp rx=0 tx=0).stop 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 msgr2=0x7f42301f81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f42280196d0 tx=0x7f4228005af0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 shutdown_connections 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f42100720c0 0x7f42100745d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f423015a370 0x7f42301f81d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4230159f60 0x7f4230164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 --2- 172.21.15.164:0/3087602942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42300c97e0 0x7f4230153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:03.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 >> 172.21.15.164:0/3087602942 conn(0x7f4230071be0 msgr2=0x7f4230155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:03.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 shutdown_connections 2024-08-31T12:21:03.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:03.711+0000 7f4236200640 1 -- 172.21.15.164:0/3087602942 wait complete. 2024-08-31T12:21:03.734 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:05.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:05.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 -- 172.21.15.164:0/4195690554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c1f40 msgr2=0x7fbcdc152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:05.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 --2- 172.21.15.164:0/4195690554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c1f40 0x7fbcdc152a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc073280 tx=0x7fbcc801eff0 comp rx=0 tx=0).stop 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 -- 172.21.15.164:0/4195690554 shutdown_connections 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 --2- 172.21.15.164:0/4195690554 >> v2:172.21.15.184:3300/0 conn(0x7fbcdc0c9330 0x7fbcdc074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 --2- 172.21.15.164:0/4195690554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c1f40 0x7fbcdc152a10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 -- 172.21.15.164:0/4195690554 >> 172.21.15.164:0/4195690554 conn(0x7fbcdc0ccf20 msgr2=0x7fbcdc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 -- 172.21.15.164:0/4195690554 shutdown_connections 2024-08-31T12:21:05.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.895+0000 7fbce3600640 1 -- 172.21.15.164:0/4195690554 wait complete. 2024-08-31T12:21:05.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 Processor -- start 2024-08-31T12:21:05.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- start start 2024-08-31T12:21:05.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 0x7fbcdc1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:05.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcdc15bc70 0x7fbcdc153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0c8030 con 0x7fbcdc0c9330 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0c3150 con 0x7fbcdc15bc70 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc074c60 con 0x7fbcdc0c1f40 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38320/0 (socket says 172.21.15.164:38320) 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 -- 172.21.15.164:0/1854150641 learned_addr learned my addr 172.21.15.164:0/1854150641 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce0c00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 0x7fbcdc1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce1600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcdc15bc70 0x7fbcdc153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 -- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 msgr2=0x7fbcdc1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 0x7fbcdc1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 -- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcdc15bc70 msgr2=0x7fbcdc153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcdc15bc70 0x7fbcdc153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 -- 172.21.15.164:0/1854150641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc1539a0 con 0x7fbcdc0c9330 2024-08-31T12:21:05.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce0c00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 0x7fbcdc1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcdbe00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009900 tx=0x7fbcc8005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80b5040 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc8003600 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc159a50 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003a10 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.899+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc154090 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcdc152a10 con 0x7fbcdc0c9330 2024-08-31T12:21:05.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbcc80c0030 con 0x7fbcdc0c9330 2024-08-31T12:21:05.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbcd8c00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 0x7fbcbc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:05.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fbcc8130440 con 0x7fbcdc0c9330 2024-08-31T12:21:05.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbce0c00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 0x7fbcbc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:05.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.903+0000 7fbce0c00640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 0x7fbcbc0745d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbccc000f70 tx=0x7fbccc009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:05.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:05.907+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbcc80c7020 con 0x7fbcdc0c9330 2024-08-31T12:21:05.994 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:21:05.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:21:06.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.107+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcdc0715f0 con 0x7fbcdc0c9330 2024-08-31T12:21:06.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.107+0000 7fbcd8c00640 1 -- 172.21.15.164:0/1854150641 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7fbcc8018b50 con 0x7fbcdc0c9330 2024-08-31T12:21:06.113 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:06.113 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:06.113 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:06.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 msgr2=0x7fbcbc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:06.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 0x7fbcbc0745d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbccc000f70 tx=0x7fbccc009040 comp rx=0 tx=0).stop 2024-08-31T12:21:06.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 msgr2=0x7fbcdc1f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:06.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009900 tx=0x7fbcc8005d20 comp rx=0 tx=0).stop 2024-08-31T12:21:06.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 shutdown_connections 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fbcbc0720c0 0x7fbcbc0745d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcdc15bc70 0x7fbcdc153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc0c9330 0x7fbcdc1f1c80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 --2- 172.21.15.164:0/1854150641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcdc0c1f40 0x7fbcdc1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 >> 172.21.15.164:0/1854150641 conn(0x7fbcdc0ccf20 msgr2=0x7fbcdc150900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 shutdown_connections 2024-08-31T12:21:06.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:06.111+0000 7fbce3600640 1 -- 172.21.15.164:0/1854150641 wait complete. 2024-08-31T12:21:06.135 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:08.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- 172.21.15.164:0/1924638961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 msgr2=0x7f975c0c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 --2- 172.21.15.164:0/1924638961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c0c7d30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f975c072540 tx=0x7f975401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- 172.21.15.164:0/1924638961 shutdown_connections 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 --2- 172.21.15.164:0/1924638961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c0c7d30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 --2- 172.21.15.164:0/1924638961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c0c1f40 0x7f975c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 --2- 172.21.15.164:0/1924638961 >> v2:172.21.15.184:3300/0 conn(0x7f975c15bc70 0x7f975c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- 172.21.15.164:0/1924638961 >> 172.21.15.164:0/1924638961 conn(0x7f975c0ccf20 msgr2=0x7f975c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- 172.21.15.164:0/1924638961 shutdown_connections 2024-08-31T12:21:08.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- 172.21.15.164:0/1924638961 wait complete. 2024-08-31T12:21:08.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 Processor -- start 2024-08-31T12:21:08.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.299+0000 7f9760c00640 1 -- start start 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f975c0c1f40 0x7f975c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c15bc70 0x7f975c1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0710c0 con 0x7f975c0c7920 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f975c070f40 con 0x7f975c0c1f40 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f975c071240 con 0x7f975c15bc70 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38340/0 (socket says 172.21.15.164:38340) 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 -- 172.21.15.164:0/3606625288 learned_addr learned my addr 172.21.15.164:0/3606625288 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f975a800640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c15bc70 0x7f975c1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9759e00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f975c0c1f40 0x7f975c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 -- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c15bc70 msgr2=0x7f975c1f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c15bc70 0x7f975c1f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 -- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f975c0c1f40 msgr2=0x7f975c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f975c0c1f40 0x7f975c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 -- 172.21.15.164:0/3606625288 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c154e20 con 0x7f975c0c7920 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9751400640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f974400d5e0 tx=0x7f974400daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744017070 con 0x7f975c0c7920 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9744009a40 con 0x7f975c0c7920 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c1630e0 con 0x7f975c0c7920 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744010460 con 0x7f975c0c7920 2024-08-31T12:21:08.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c155090 con 0x7f975c0c7920 2024-08-31T12:21:08.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c0c7d30 con 0x7f975c0c7920 2024-08-31T12:21:08.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.303+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f974401a070 con 0x7f975c0c7920 2024-08-31T12:21:08.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.307+0000 7f9752a00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 0x7f97380745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:08.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.307+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f97440930b0 con 0x7f975c0c7920 2024-08-31T12:21:08.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.307+0000 7f9759e00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 0x7f97380745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:08.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.307+0000 7f9759e00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 0x7f97380745d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f974c005c50 tx=0x7f974c005be0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:08.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.311+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f974405e5a0 con 0x7f975c0c7920 2024-08-31T12:21:08.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.507+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f975c0b2a60 con 0x7f975c0c7920 2024-08-31T12:21:08.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.507+0000 7f9752a00640 1 -- 172.21.15.164:0/3606625288 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7f974405dea0 con 0x7f975c0c7920 2024-08-31T12:21:08.512 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:08.512 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:08.512 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:08.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 msgr2=0x7f97380745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:08.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 0x7f97380745d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f974c005c50 tx=0x7f974c005be0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 msgr2=0x7f975c154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f974400d5e0 tx=0x7f974400daa0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 shutdown_connections 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f97380720c0 0x7f97380745d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f975c15bc70 0x7f975c1f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f975c0c7920 0x7f975c154200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 --2- 172.21.15.164:0/3606625288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f975c0c1f40 0x7f975c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 >> 172.21.15.164:0/3606625288 conn(0x7f975c0ccf20 msgr2=0x7f975c0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 shutdown_connections 2024-08-31T12:21:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:08.511+0000 7f9760c00640 1 -- 172.21.15.164:0/3606625288 wait complete. 2024-08-31T12:21:08.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:10.536 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 -- 172.21.15.164:0/1367748843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c153b90 msgr2=0x7fe18c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 --2- 172.21.15.164:0/1367748843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c153b90 0x7fe18c159a70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ceec0 tx=0x7fe18401cd80 comp rx=0 tx=0).stop 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 -- 172.21.15.164:0/1367748843 shutdown_connections 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 --2- 172.21.15.164:0/1367748843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c153b90 0x7fe18c159a70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 --2- 172.21.15.164:0/1367748843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c0ca930 0x7fe18c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 --2- 172.21.15.164:0/1367748843 >> v2:172.21.15.184:3300/0 conn(0x7fe18c0c4760 0x7fe18c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 -- 172.21.15.164:0/1367748843 >> 172.21.15.164:0/1367748843 conn(0x7fe18c0717b0 msgr2=0x7fe18c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 -- 172.21.15.164:0/1367748843 shutdown_connections 2024-08-31T12:21:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.695+0000 7fe193e00640 1 -- 172.21.15.164:0/1367748843 wait complete. 2024-08-31T12:21:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 Processor -- start 2024-08-31T12:21:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 -- start start 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe18c0c4760 0x7fe18c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c153b90 0x7fe18c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c15a3c0 con 0x7fe18c0ca930 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c0b2aa0 con 0x7fe18c0c4760 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe193e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c0b2c20 con 0x7fe18c153b90 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe190a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe190a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38354/0 (socket says 172.21.15.164:38354) 2024-08-31T12:21:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe190a00640 1 -- 172.21.15.164:0/3475539960 learned_addr learned my addr 172.21.15.164:0/3475539960 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.699+0000 7fe191e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c153b90 0x7fe18c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe191400640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe18c0c4760 0x7fe18c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 -- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c153b90 msgr2=0x7fe18c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c153b90 0x7fe18c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 -- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe18c0c4760 msgr2=0x7fe18c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe18c0c4760 0x7fe18c0b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 -- 172.21.15.164:0/3475539960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c1f5d40 con 0x7fe18c0ca930 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe190a00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe178005d10 tx=0x7fe17800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178017070 con 0x7fe18c0ca930 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe178009b20 con 0x7fe18c0ca930 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c0cd030 con 0x7fe18c0ca930 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178005020 con 0x7fe18c0ca930 2024-08-31T12:21:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c0cd5f0 con 0x7fe18c0ca930 2024-08-31T12:21:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c153650 con 0x7fe18c0ca930 2024-08-31T12:21:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe1780051c0 con 0x7fe18c0ca930 2024-08-31T12:21:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 0x7fe16c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.703+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7fe1780930e0 con 0x7fe18c0ca930 2024-08-31T12:21:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.707+0000 7fe191400640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 0x7fe16c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:10.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.707+0000 7fe191400640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 0x7fe16c0745d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe180005fd0 tx=0x7fe180005d80 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.711+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe17805e5d0 con 0x7fe18c0ca930 2024-08-31T12:21:10.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.919+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe18c13f630 con 0x7fe18c0ca930 2024-08-31T12:21:10.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.919+0000 7fe189600640 1 -- 172.21.15.164:0/3475539960 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7fe17805ded0 con 0x7fe18c0ca930 2024-08-31T12:21:10.924 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:10.925 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:10.925 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 msgr2=0x7fe16c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 0x7fe16c0745d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe180005fd0 tx=0x7fe180005d80 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 msgr2=0x7fe18c1f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe178005d10 tx=0x7fe17800dbb0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 shutdown_connections 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe16c0720c0 0x7fe16c0745d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe18c153b90 0x7fe18c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe18c0ca930 0x7fe18c1f5800 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 --2- 172.21.15.164:0/3475539960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe18c0c4760 0x7fe18c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 >> 172.21.15.164:0/3475539960 conn(0x7fe18c0717b0 msgr2=0x7fe18c150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 shutdown_connections 2024-08-31T12:21:10.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:10.923+0000 7fe193e00640 1 -- 172.21.15.164:0/3475539960 wait complete. 2024-08-31T12:21:10.946 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:12.947 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:13.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 -- 172.21.15.164:0/2984416671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 msgr2=0x7f0524152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 --2- 172.21.15.164:0/2984416671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f0524152a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0524070b70 tx=0x7f051401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 -- 172.21.15.164:0/2984416671 shutdown_connections 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 --2- 172.21.15.164:0/2984416671 >> v2:172.21.15.184:3300/0 conn(0x7f05240c1f40 0x7f05240c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 --2- 172.21.15.164:0/2984416671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f0524152a10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 -- 172.21.15.164:0/2984416671 >> 172.21.15.164:0/2984416671 conn(0x7f05240ccf20 msgr2=0x7f05240cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 -- 172.21.15.164:0/2984416671 shutdown_connections 2024-08-31T12:21:13.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.107+0000 7f052a000640 1 -- 172.21.15.164:0/2984416671 wait complete. 2024-08-31T12:21:13.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 Processor -- start 2024-08-31T12:21:13.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- start start 2024-08-31T12:21:13.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 0x7f05241f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:13.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05240c7920 0x7f05240767a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:13.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f052414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:13.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0524074fb0 con 0x7f052415bc70 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0524074e30 con 0x7f05240c1f40 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f05240c7d30 con 0x7f05240c7920 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 0x7f05241f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 0x7f05241f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.164:37962/0 (socket says 172.21.15.164:37962) 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f052414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523400640 1 -- 172.21.15.164:0/2026204378 learned_addr learned my addr 172.21.15.164:0/2026204378 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:13.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f051aa00640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05240c7920 0x7f05240767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 -- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05240c7920 msgr2=0x7f05240767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05240c7920 0x7f05240767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 -- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 msgr2=0x7f05241f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 0x7f05241f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 -- 172.21.15.164:0/2026204378 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05241f36d0 con 0x7f052415bc70 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f0523e00640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f052414e910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f051c00bdd0 tx=0x7f051c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c019070 con 0x7f052415bc70 2024-08-31T12:21:13.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051c014440 con 0x7f052415bc70 2024-08-31T12:21:13.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05241efef0 con 0x7f052415bc70 2024-08-31T12:21:13.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c0148d0 con 0x7f052415bc70 2024-08-31T12:21:13.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.111+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05241f04b0 con 0x7f052415bc70 2024-08-31T12:21:13.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.115+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05240c9330 con 0x7f052415bc70 2024-08-31T12:21:13.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.115+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f051c01c070 con 0x7f052415bc70 2024-08-31T12:21:13.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.115+0000 7f051be00640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 0x7f0500074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:13.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.115+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f051c092db0 con 0x7f052415bc70 2024-08-31T12:21:13.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.115+0000 7f0523400640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 0x7f0500074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:13.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.119+0000 7f0523400640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 0x7f0500074600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0514009230 tx=0x7f051401d8f0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:13.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.119+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f051c097070 con 0x7f052415bc70 2024-08-31T12:21:13.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.319+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0524157220 con 0x7f052415bc70 2024-08-31T12:21:13.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.319+0000 7f051be00640 1 -- 172.21.15.164:0/2026204378 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7f051c05dbd0 con 0x7f052415bc70 2024-08-31T12:21:13.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:13.324 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:13.324 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:13.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 msgr2=0x7f0500074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:13.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 0x7f0500074600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0514009230 tx=0x7f051401d8f0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 msgr2=0x7f052414e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f052414e910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f051c00bdd0 tx=0x7f051c009ed0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 shutdown_connections 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f05000720f0 0x7f0500074600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f052415bc70 0x7f052414e910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05240c7920 0x7f05240767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 --2- 172.21.15.164:0/2026204378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05240c1f40 0x7f05241f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 >> 172.21.15.164:0/2026204378 conn(0x7f05240ccf20 msgr2=0x7f05240b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 shutdown_connections 2024-08-31T12:21:13.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:13.323+0000 7f052a000640 1 -- 172.21.15.164:0/2026204378 wait complete. 2024-08-31T12:21:13.347 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:15.348 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- 172.21.15.164:0/1523193556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c0c1f40 msgr2=0x7f7b2c0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 --2- 172.21.15.164:0/1523193556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c0c9330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0c9020 tx=0x7f7b1401f010 comp rx=0 tx=0).stop 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- 172.21.15.164:0/1523193556 shutdown_connections 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 --2- 172.21.15.164:0/1523193556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c0c9330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 --2- 172.21.15.164:0/1523193556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c15bc70 0x7f7b2c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- 172.21.15.164:0/1523193556 >> 172.21.15.164:0/1523193556 conn(0x7f7b2c0ccf20 msgr2=0x7f7b2c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- 172.21.15.164:0/1523193556 shutdown_connections 2024-08-31T12:21:15.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- 172.21.15.164:0/1523193556 wait complete. 2024-08-31T12:21:15.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 Processor -- start 2024-08-31T12:21:15.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.511+0000 7f7b33a00640 1 -- start start 2024-08-31T12:21:15.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0c7920 0x7f7b2c1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c074fb0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c074e30 con 0x7f7b2c0c1f40 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0c7d30 con 0x7f7b2c0c7920 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34764/0 (socket says 172.21.15.164:34764) 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 -- 172.21.15.164:0/146681471 learned_addr learned my addr 172.21.15.164:0/146681471 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b23e00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0c7920 0x7f7b2c1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31000640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 -- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0c7920 msgr2=0x7f7b2c1f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:15.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0c7920 0x7f7b2c1f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 -- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0c1f40 msgr2=0x7f7b2c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 -- 172.21.15.164:0/146681471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c159500 con 0x7f7b2c15bc70 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b31a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c760 tx=0x7f7b2400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24003db0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b2400ce10 con 0x7f7b2c15bc70 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c15b1e0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240052d0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c1f5620 con 0x7f7b2c15bc70 2024-08-31T12:21:15.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c0c9330 con 0x7f7b2c15bc70 2024-08-31T12:21:15.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.515+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7b24005470 con 0x7f7b2c15bc70 2024-08-31T12:21:15.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.519+0000 7f7b29600640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 0x7f7b080745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:15.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.519+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6848+0+0 (secure 0 0 0) 0x7f7b24092cb0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.519+0000 7f7b31000640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 0x7f7b080745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:15.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.519+0000 7f7b31000640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 0x7f7b080745d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c004630 tx=0x7f7b1c00b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:15.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.523+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7b2405da30 con 0x7f7b2c15bc70 2024-08-31T12:21:15.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.723+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b2c1560a0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.723+0000 7f7b29600640 1 -- 172.21.15.164:0/146681471 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6892 (secure 0 0 0) 0x7f7b240621f0 con 0x7f7b2c15bc70 2024-08-31T12:21:15.728 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:15.728 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"btime":"2024-08-31T12:20:53:810513+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:20:45.857949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5125":{"gid":5125,"name":"d","rank":0,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/4233946054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4233946054},{"type":"v1","addr":"172.21.15.184:6837","nonce":4233946054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5125,"qdb_cluster":[5125]},"id":1}]} 2024-08-31T12:21:15.728 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-08-31T12:21:15.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 msgr2=0x7f7b080745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:15.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 0x7f7b080745d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c004630 tx=0x7f7b1c00b2e0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 msgr2=0x7f7b2c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c760 tx=0x7f7b2400cc20 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 shutdown_connections 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7b080720c0 0x7f7b080745d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c15bc70 0x7f7b2c070ee0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0c7920 0x7f7b2c1f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 --2- 172.21.15.164:0/146681471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0c1f40 0x7f7b2c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 >> 172.21.15.164:0/146681471 conn(0x7f7b2c0ccf20 msgr2=0x7f7b2c074550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 shutdown_connections 2024-08-31T12:21:15.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:15.727+0000 7f7b33a00640 1 -- 172.21.15.164:0/146681471 wait complete. 2024-08-31T12:21:15.751 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-08-31T12:21:17.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- 172.21.15.164:0/3314553991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 msgr2=0x7fe550004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 --2- 172.21.15.164:0/3314553991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe550004c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe56c074690 tx=0x7fe55401cf20 comp rx=0 tx=0).stop 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- 172.21.15.164:0/3314553991 shutdown_connections 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 --2- 172.21.15.164:0/3314553991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe550004c20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- 172.21.15.164:0/3314553991 >> 172.21.15.164:0/3314553991 conn(0x7fe56c06dd40 msgr2=0x7fe56c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- 172.21.15.164:0/3314553991 shutdown_connections 2024-08-31T12:21:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- 172.21.15.164:0/3314553991 wait complete. 2024-08-31T12:21:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 Processor -- start 2024-08-31T12:21:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.915+0000 7fe570c00640 1 -- start start 2024-08-31T12:21:17.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:17.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe56c0cc8a0 0x7fe56c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 0x7fe56c0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0c95b0 con 0x7fe550004810 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0c92d0 con 0x7fe56c0cd960 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c153b10 con 0x7fe56c0cc8a0 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34786/0 (socket says 172.21.15.164:34786) 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 -- 172.21.15.164:0/2748708154 learned_addr learned my addr 172.21.15.164:0/2748708154 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe561400640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe56c0cc8a0 0x7fe56c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe56a800640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 0x7fe56c0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 -- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe56c0cc8a0 msgr2=0x7fe56c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe56c0cc8a0 0x7fe56c14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 -- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 msgr2=0x7fe56c0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:17.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 0x7fe56c0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 -- 172.21.15.164:0/2748708154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c14f0f0 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe56a800640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 0x7fe56c0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe569e00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe55c011780 tx=0x7fe55c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c01f070 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe55c011e90 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0126b0 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c1594c0 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c1f0da0 con 0x7fe550004810 2024-08-31T12:21:17.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c0c9ad0 con 0x7fe550004810 2024-08-31T12:21:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.919+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe55c022070 con 0x7fe550004810 2024-08-31T12:21:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.923+0000 7fe562a00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 0x7fe548074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.923+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fe55c093a50 con 0x7fe550004810 2024-08-31T12:21:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.923+0000 7fe561400640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 0x7fe548074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.923+0000 7fe561400640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 0x7fe548074600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe5540ac000 tx=0x7fe554019d60 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:17.927+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe55c00fe60 con 0x7fe550004810 2024-08-31T12:21:18.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.123+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe56c0c5680 con 0x7fe550004810 2024-08-31T12:21:18.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe562a00640 1 -- 172.21.15.164:0/2748708154 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6056 (secure 0 0 0) 0x7fe55c05e7e0 con 0x7fe550004810 2024-08-31T12:21:18.129 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:18.130 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"btime":"2024-08-31T12:21:16:365869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:16.365864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 27 2024-08-31T12:21:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 msgr2=0x7fe548074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 0x7fe548074600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe5540ac000 tx=0x7fe554019d60 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 msgr2=0x7fe56c14e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe55c011780 tx=0x7fe55c011c40 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 shutdown_connections 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe5480720f0 0x7fe548074600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56c0cd960 0x7fe56c0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe56c0cc8a0 0x7fe56c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 --2- 172.21.15.164:0/2748708154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe550004810 0x7fe56c14e670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 >> 172.21.15.164:0/2748708154 conn(0x7fe56c06dd40 msgr2=0x7fe56c15a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 shutdown_connections 2024-08-31T12:21:18.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.127+0000 7fe570c00640 1 -- 172.21.15.164:0/2748708154 wait complete. 2024-08-31T12:21:18.151 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-08-31T12:21:18.152 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-08-31T12:21:18.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- 172.21.15.164:0/791247903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0b2900 msgr2=0x7fe19c1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 --2- 172.21.15.164:0/791247903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0b2900 0x7fe19c1520f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe18400a950 tx=0x7fe18401dae0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- 172.21.15.164:0/791247903 shutdown_connections 2024-08-31T12:21:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 --2- 172.21.15.164:0/791247903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0b2900 0x7fe19c1520f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- 172.21.15.164:0/791247903 >> 172.21.15.164:0/791247903 conn(0x7fe19c0ccf20 msgr2=0x7fe19c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- 172.21.15.164:0/791247903 shutdown_connections 2024-08-31T12:21:18.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- 172.21.15.164:0/791247903 wait complete. 2024-08-31T12:21:18.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 Processor -- start 2024-08-31T12:21:18.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- start start 2024-08-31T12:21:18.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe19c0b2900 0x7fe19c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:18.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19c0b2fe0 0x7fe19c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c158980 con 0x7fe19c0c8810 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c158800 con 0x7fe19c0b2fe0 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.303+0000 7fe1a3600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c165e80 con 0x7fe19c0b2900 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34802/0 (socket says 172.21.15.164:34802) 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 -- 172.21.15.164:0/319604561 learned_addr learned my addr 172.21.15.164:0/319604561 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a0c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe19c0b2900 0x7fe19c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe193e00640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19c0b2fe0 0x7fe19c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 -- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe19c0b2900 msgr2=0x7fe19c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe19c0b2900 0x7fe19c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 -- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19c0b2fe0 msgr2=0x7fe19c0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19c0b2fe0 0x7fe19c0c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 -- 172.21.15.164:0/319604561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0c6fb0 con 0x7fe19c0c8810 2024-08-31T12:21:18.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a1600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c710 tx=0x7fe19400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:18.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194003b80 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe194003d20 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400aab0 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c14fed0 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c0c4850 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c1520f0 con 0x7fe19c0c8810 2024-08-31T12:21:18.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.307+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe19400ac50 con 0x7fe19c0c8810 2024-08-31T12:21:18.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.311+0000 7fe199600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 0x7fe1780745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:18.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.311+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fe194092e80 con 0x7fe19c0c8810 2024-08-31T12:21:18.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.311+0000 7fe1a0c00640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 0x7fe1780745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:18.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.311+0000 7fe1a0c00640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 0x7fe1780745d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0046c0 tx=0x7fe18c007cd0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:18.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.311+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe19400ce20 con 0x7fe19c0c8810 2024-08-31T12:21:18.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.511+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe19c1557f0 con 0x7fe19c0c8810 2024-08-31T12:21:18.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.511+0000 7fe199600640 1 -- 172.21.15.164:0/319604561 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6056 (secure 0 0 0) 0x7fe19405e370 con 0x7fe19c0c8810 2024-08-31T12:21:18.516 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:18.516 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"btime":"2024-08-31T12:21:16:365869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:16.365864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:18.516 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 27 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 msgr2=0x7fe1780745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 0x7fe1780745d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0046c0 tx=0x7fe18c007cd0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 msgr2=0x7fe19c0b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c710 tx=0x7fe19400cbd0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 shutdown_connections 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1780720c0 0x7fe1780745d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0c8810 0x7fe19c0b0c70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19c0b2fe0 0x7fe19c0c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 --2- 172.21.15.164:0/319604561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe19c0b2900 0x7fe19c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:18.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 >> 172.21.15.164:0/319604561 conn(0x7fe19c0ccf20 msgr2=0x7fe19c14e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:18.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 shutdown_connections 2024-08-31T12:21:18.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:18.515+0000 7fe1a3600640 1 -- 172.21.15.164:0/319604561 wait complete. 2024-08-31T12:21:18.538 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:21:16:365869+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5274": { "addr": "172.21.15.164:6835/2530648468", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6834", "nonce": 2530648468, "type": "v2" }, { "addr": "172.21.15.164:6835", "nonce": 2530648468, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5274, "incarnation": 27, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 56, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:21:16.365864+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5274 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:21:20.540 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 -- 172.21.15.164:0/1398183162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 msgr2=0x7f7214152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 --2- 172.21.15.164:0/1398183162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f7214152a10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7204009c80 tx=0x7f720401f5a0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 -- 172.21.15.164:0/1398183162 shutdown_connections 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 --2- 172.21.15.164:0/1398183162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c9330 0x7f7214074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 --2- 172.21.15.164:0/1398183162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f7214152a10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 -- 172.21.15.164:0/1398183162 >> 172.21.15.164:0/1398183162 conn(0x7f72140ccf20 msgr2=0x7f72140cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 -- 172.21.15.164:0/1398183162 shutdown_connections 2024-08-31T12:21:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.699+0000 7f721b000640 1 -- 172.21.15.164:0/1398183162 wait complete. 2024-08-31T12:21:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 Processor -- start 2024-08-31T12:21:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- start start 2024-08-31T12:21:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 0x7f7214157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72140c9330 0x7f72140c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f72140c8030 con 0x7f721415bc70 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72140c3150 con 0x7f72140c9330 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f7214074c60 con 0x7f72140c1f40 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34828/0 (socket says 172.21.15.164:34828) 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 -- 172.21.15.164:0/1836259621 learned_addr learned my addr 172.21.15.164:0/1836259621 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7213e00640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 0x7f7214157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f720b400640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72140c9330 0x7f72140c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 -- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 msgr2=0x7f7214157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 0x7f7214157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 -- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72140c9330 msgr2=0x7f72140c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72140c9330 0x7f72140c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 -- 172.21.15.164:0/1836259621 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72141e5990 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7213e00640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 0x7f7214157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7219000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d660 tx=0x7f720c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c017070 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f720c005310 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c009820 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72141580d0 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.703+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72140c6650 con 0x7f721415bc70 2024-08-31T12:21:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.707+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7214074720 con 0x7f721415bc70 2024-08-31T12:21:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.707+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f720c0099c0 con 0x7f721415bc70 2024-08-31T12:21:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.707+0000 7f7210c00640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 0x7f71f00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.707+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f720c093170 con 0x7f721415bc70 2024-08-31T12:21:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.707+0000 7f7213e00640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 0x7f71f00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.711+0000 7f7213e00640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 0x7f71f00745d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f72040b3000 tx=0x7f720401dde0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:20.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.711+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f720c05e550 con 0x7f721415bc70 2024-08-31T12:21:20.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.915+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72141560a0 con 0x7f721415bc70 2024-08-31T12:21:20.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.915+0000 7f7210c00640 1 -- 172.21.15.164:0/1836259621 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6056 (secure 0 0 0) 0x7f720c05de50 con 0x7f721415bc70 2024-08-31T12:21:20.919 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:20.919 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"btime":"2024-08-31T12:21:16:365869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:16.365864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:20.919 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 27 2024-08-31T12:21:20.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 msgr2=0x7f71f00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:20.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 0x7f71f00745d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f72040b3000 tx=0x7f720401dde0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 msgr2=0x7f721414f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d660 tx=0x7f720c00db20 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 shutdown_connections 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f71f00720c0 0x7f71f00745d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721415bc70 0x7f721414f180 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72140c9330 0x7f72140c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 --2- 172.21.15.164:0/1836259621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72140c1f40 0x7f7214157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 >> 172.21.15.164:0/1836259621 conn(0x7f72140ccf20 msgr2=0x7f7214070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 shutdown_connections 2024-08-31T12:21:20.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:20.919+0000 7f721b000640 1 -- 172.21.15.164:0/1836259621 wait complete. 2024-08-31T12:21:20.941 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:22.941 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 -- 172.21.15.164:0/3449890934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1780ca970 msgr2=0x7fd1780cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 --2- 172.21.15.164:0/3449890934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1780ca970 0x7fd1780cf2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd160009870 tx=0x7fd16001f010 comp rx=0 tx=0).stop 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 -- 172.21.15.164:0/3449890934 shutdown_connections 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 --2- 172.21.15.164:0/3449890934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1780ca970 0x7fd1780cf2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 --2- 172.21.15.164:0/3449890934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 0x7fd1780ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 -- 172.21.15.164:0/3449890934 >> 172.21.15.164:0/3449890934 conn(0x7fd178073630 msgr2=0x7fd178073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 -- 172.21.15.164:0/3449890934 shutdown_connections 2024-08-31T12:21:23.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.099+0000 7fd17da00640 1 -- 172.21.15.164:0/3449890934 wait complete. 2024-08-31T12:21:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 Processor -- start 2024-08-31T12:21:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- start start 2024-08-31T12:21:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 0x7fd1781f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 0x7fd17814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd1780c5ed0 con 0x7fd178155e30 2024-08-31T12:21:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd1780c5d50 con 0x7fd1780ca970 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd17815f8b0 con 0x7fd178155a20 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34852/0 (socket says 172.21.15.164:34852) 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 -- 172.21.15.164:0/902004569 learned_addr learned my addr 172.21.15.164:0/902004569 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd16e000640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 0x7fd17814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd176a00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 0x7fd1781f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 -- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 msgr2=0x7fd17814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 0x7fd17814bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 -- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 msgr2=0x7fd1781f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 0x7fd1781f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 -- 172.21.15.164:0/902004569 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1781f2190 con 0x7fd178155e30 2024-08-31T12:21:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd176a00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 0x7fd1781f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:23.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd177400640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd17000cad0 tx=0x7fd17000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:23.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170016020 con 0x7fd178155e30 2024-08-31T12:21:23.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd17000ab40 con 0x7fd178155e30 2024-08-31T12:21:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17814c7e0 con 0x7fd178155e30 2024-08-31T12:21:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17000ce10 con 0x7fd178155e30 2024-08-31T12:21:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.103+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17814cda0 con 0x7fd178155e30 2024-08-31T12:21:23.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.107+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17814dbf0 con 0x7fd178155e30 2024-08-31T12:21:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.107+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd170019020 con 0x7fd178155e30 2024-08-31T12:21:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.111+0000 7fd16f400640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 0x7fd1540745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.111+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fd170093560 con 0x7fd178155e30 2024-08-31T12:21:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.111+0000 7fd176a00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 0x7fd1540745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.111+0000 7fd176a00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 0x7fd1540745d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd168009b90 tx=0x7fd1680091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.111+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd170020020 con 0x7fd178155e30 2024-08-31T12:21:23.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.327+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd17814d900 con 0x7fd178155e30 2024-08-31T12:21:23.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd16f400640 1 -- 172.21.15.164:0/902004569 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6056 (secure 0 0 0) 0x7fd17005eac0 con 0x7fd178155e30 2024-08-31T12:21:23.333 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:23.333 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":27,"btime":"2024-08-31T12:21:16:365869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:16.365864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:23.333 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 27 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 msgr2=0x7fd1540745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 0x7fd1540745d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd168009b90 tx=0x7fd1680091e0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 msgr2=0x7fd178149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd17000cad0 tx=0x7fd17000cbc0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 shutdown_connections 2024-08-31T12:21:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fd1540720c0 0x7fd1540745d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd178155e30 0x7fd178149920 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd178155a20 0x7fd17814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 --2- 172.21.15.164:0/902004569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1780ca970 0x7fd1781f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 >> 172.21.15.164:0/902004569 conn(0x7fd178073630 msgr2=0x7fd1781532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 shutdown_connections 2024-08-31T12:21:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:23.331+0000 7fd17da00640 1 -- 172.21.15.164:0/902004569 wait complete. 2024-08-31T12:21:23.356 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:25.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 -- 172.21.15.164:0/2010745703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 msgr2=0x7f48ec166250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 --2- 172.21.15.164:0/2010745703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec166250 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f48ec072c80 tx=0x7f48e401f580 comp rx=0 tx=0).stop 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 -- 172.21.15.164:0/2010745703 shutdown_connections 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 --2- 172.21.15.164:0/2010745703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec166250 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 --2- 172.21.15.164:0/2010745703 >> v2:172.21.15.184:3300/0 conn(0x7f48ec0c5990 0x7f48ec15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 -- 172.21.15.164:0/2010745703 >> 172.21.15.164:0/2010745703 conn(0x7f48ec06cc30 msgr2=0x7f48ec06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 -- 172.21.15.164:0/2010745703 shutdown_connections 2024-08-31T12:21:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 -- 172.21.15.164:0/2010745703 wait complete. 2024-08-31T12:21:25.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.519+0000 7f48eb200640 1 Processor -- start 2024-08-31T12:21:25.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- start start 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ec0c5990 0x7f48ec0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ec155e10 0x7f48ec1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec15eec0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec0ca9c0 con 0x7f48ec0c5990 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f48ec15f1a0 con 0x7f48ec155e10 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59530/0 (socket says 172.21.15.164:59530) 2024-08-31T12:21:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 -- 172.21.15.164:0/4009263454 learned_addr learned my addr 172.21.15.164:0/4009263454 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48e1400640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ec155e10 0x7f48ec1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48e9e00640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ec0c5990 0x7f48ec0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 -- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ec155e10 msgr2=0x7f48ec1f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ec155e10 0x7f48ec1f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 -- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ec0c5990 msgr2=0x7f48ec0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ec0c5990 0x7f48ec0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 -- 172.21.15.164:0/4009263454 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec0c8780 con 0x7f48ec15f9a0 2024-08-31T12:21:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48ea800640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f48e401dc30 tx=0x7f48e4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40b5040 con 0x7f48ec15f9a0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48e40be070 con 0x7f48ec15f9a0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec1f1db0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40b0aa0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec0c8d20 con 0x7f48ec15f9a0 2024-08-31T12:21:25.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.523+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ec0c8ef0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.527+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f48e40b0c40 con 0x7f48ec15f9a0 2024-08-31T12:21:25.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.527+0000 7f48e2a00640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 0x7f48c8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:25.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.527+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f48e4130ef0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.527+0000 7f48e9e00640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 0x7f48c8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.527+0000 7f48e9e00640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 0x7f48c8074600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00b810 tx=0x7f48dc008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.531+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f48e40190e0 con 0x7f48ec15f9a0 2024-08-31T12:21:25.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.731+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48ec06dd40 con 0x7f48ec15f9a0 2024-08-31T12:21:25.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.731+0000 7f48e2a00640 1 -- 172.21.15.164:0/4009263454 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6059 (secure 0 0 0) 0x7f48e40fc360 con 0x7f48ec15f9a0 2024-08-31T12:21:25.735 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:25.735 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"btime":"2024-08-31T12:21:24:831227+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:23.851717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:25.736 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 28 2024-08-31T12:21:25.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 msgr2=0x7f48c8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 0x7f48c8074600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00b810 tx=0x7f48dc008040 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 msgr2=0x7f48ec1596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f48e401dc30 tx=0x7f48e4005b10 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 shutdown_connections 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f48c80720f0 0x7f48c8074600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48ec15f9a0 0x7f48ec1596e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ec155e10 0x7f48ec1f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 --2- 172.21.15.164:0/4009263454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ec0c5990 0x7f48ec0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 >> 172.21.15.164:0/4009263454 conn(0x7f48ec06cc30 msgr2=0x7f48ec150080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 shutdown_connections 2024-08-31T12:21:25.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:25.735+0000 7f48eb200640 1 -- 172.21.15.164:0/4009263454 wait complete. 2024-08-31T12:21:25.757 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:27.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 -- 172.21.15.164:0/918718715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c1f40 msgr2=0x7f134c0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 --2- 172.21.15.164:0/918718715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c1f40 0x7f134c0c9330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f134c0c9020 tx=0x7f133401f010 comp rx=0 tx=0).stop 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 -- 172.21.15.164:0/918718715 shutdown_connections 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 --2- 172.21.15.164:0/918718715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c1f40 0x7f134c0c9330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 --2- 172.21.15.164:0/918718715 >> v2:172.21.15.184:3300/0 conn(0x7f134c15bc70 0x7f134c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 -- 172.21.15.164:0/918718715 >> 172.21.15.164:0/918718715 conn(0x7f134c0ccf20 msgr2=0x7f134c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 -- 172.21.15.164:0/918718715 shutdown_connections 2024-08-31T12:21:27.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.919+0000 7f1352000640 1 -- 172.21.15.164:0/918718715 wait complete. 2024-08-31T12:21:27.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 Processor -- start 2024-08-31T12:21:27.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 -- start start 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f134c0c1f40 0x7f134c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c7920 0x7f134c14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f134c074fb0 con 0x7f134c15bc70 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f134c074e30 con 0x7f134c0c1f40 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f1352000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f134c0c7d30 con 0x7f134c0c7920 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f134be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f134be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59546/0 (socket says 172.21.15.164:59546) 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.923+0000 7f134be00640 1 -- 172.21.15.164:0/2406362748 learned_addr learned my addr 172.21.15.164:0/2406362748 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:27.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134b400640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f134c0c1f40 0x7f134c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1342a00640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c7920 0x7f134c14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 -- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c7920 msgr2=0x7f134c14fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c7920 0x7f134c14fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 -- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f134c0c1f40 msgr2=0x7f134c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f134c0c1f40 0x7f134c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 -- 172.21.15.164:0/2406362748 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c153630 con 0x7f134c15bc70 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f134be00640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f134400c370 tx=0x7f134400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344017070 con 0x7f134c15bc70 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13440053c0 con 0x7f134c15bc70 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c14fa10 con 0x7f134c15bc70 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344003860 con 0x7f134c15bc70 2024-08-31T12:21:27.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c0c68a0 con 0x7f134c15bc70 2024-08-31T12:21:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134c14fbe0 con 0x7f134c15bc70 2024-08-31T12:21:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.927+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f134401a070 con 0x7f134c15bc70 2024-08-31T12:21:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.931+0000 7f1343e00640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 0x7f13280745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.931+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f1344092380 con 0x7f134c15bc70 2024-08-31T12:21:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.931+0000 7f134b400640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 0x7f13280745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.931+0000 7f134b400640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 0x7f13280745d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f133c009a40 tx=0x7f133c010040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:27.935+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f134405d110 con 0x7f134c15bc70 2024-08-31T12:21:28.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.131+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f134c152cb0 con 0x7f134c15bc70 2024-08-31T12:21:28.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1343e00640 1 -- 172.21.15.164:0/2406362748 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6059 (secure 0 0 0) 0x7f13440618d0 con 0x7f134c15bc70 2024-08-31T12:21:28.137 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:28.138 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"btime":"2024-08-31T12:21:24:831227+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:23.851717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 28 2024-08-31T12:21:28.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 msgr2=0x7f13280745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 0x7f13280745d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f133c009a40 tx=0x7f133c010040 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 msgr2=0x7f134c14f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f134400c370 tx=0x7f134400c830 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 shutdown_connections 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13280720c0 0x7f13280745d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f134c15bc70 0x7f134c14f4d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f134c0c7920 0x7f134c14fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 --2- 172.21.15.164:0/2406362748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f134c0c1f40 0x7f134c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 >> 172.21.15.164:0/2406362748 conn(0x7f134c0ccf20 msgr2=0x7f134c146a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 shutdown_connections 2024-08-31T12:21:28.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:28.135+0000 7f1352000640 1 -- 172.21.15.164:0/2406362748 wait complete. 2024-08-31T12:21:28.159 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:30.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 -- 172.21.15.164:0/3470594708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 msgr2=0x7f4ee4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 --2- 172.21.15.164:0/3470594708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80016f0 tx=0x7f4ee801c750 comp rx=0 tx=0).stop 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 -- 172.21.15.164:0/3470594708 shutdown_connections 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 --2- 172.21.15.164:0/3470594708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 -- 172.21.15.164:0/3470594708 >> 172.21.15.164:0/3470594708 conn(0x7f4f000ccf20 msgr2=0x7f4f000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 -- 172.21.15.164:0/3470594708 shutdown_connections 2024-08-31T12:21:30.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.323+0000 7f4f07200640 1 -- 172.21.15.164:0/3470594708 wait complete. 2024-08-31T12:21:30.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 Processor -- start 2024-08-31T12:21:30.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- start start 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f000c5570 0x7f4f0014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f0014c5c0 0x7f4f0014c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00152a10 con 0x7f4ee4004810 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000c3150 con 0x7f4f000c5570 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4f00152b90 con 0x7f4f0014c5c0 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59564/0 (socket says 172.21.15.164:59564) 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 -- 172.21.15.164:0/456635407 learned_addr learned my addr 172.21.15.164:0/456635407 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4ef7400640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f000c5570 0x7f4f0014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f05200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f0014c5c0 0x7f4f0014c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:30.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 -- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f0014c5c0 msgr2=0x7f4f0014c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f0014c5c0 0x7f4f0014c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 -- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f000c5570 msgr2=0x7f4f0014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f000c5570 0x7f4f0014f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 -- 172.21.15.164:0/456635407 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f00157a30 con 0x7f4ee4004810 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4effe00640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00117b0 tx=0x7f4ef0011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001f070 con 0x7f4ee4004810 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ef000fe40 con 0x7f4ee4004810 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00126b0 con 0x7f4ee4004810 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f00157d10 con 0x7f4ee4004810 2024-08-31T12:21:30.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f001582d0 con 0x7f4ee4004810 2024-08-31T12:21:30.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.327+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f000c7920 con 0x7f4ee4004810 2024-08-31T12:21:30.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.331+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4ef0022070 con 0x7f4ee4004810 2024-08-31T12:21:30.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.331+0000 7f4efcc00640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 0x7f4edc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:30.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.331+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f4ef0093a40 con 0x7f4ee4004810 2024-08-31T12:21:30.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.331+0000 7f4ef7400640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 0x7f4edc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.331+0000 7f4ef7400640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 0x7f4edc074600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80016c0 tx=0x7f4ee80a7040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.335+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4ef005e7d0 con 0x7f4ee4004810 2024-08-31T12:21:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.535+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f001560a0 con 0x7f4ee4004810 2024-08-31T12:21:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.535+0000 7f4efcc00640 1 -- 172.21.15.164:0/456635407 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6057 (secure 0 0 0) 0x7f4ef0091e20 con 0x7f4ee4004810 2024-08-31T12:21:30.539 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:30.539 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":29,"btime":"2024-08-31T12:21:30:391672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:29.843343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 29 2024-08-31T12:21:30.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.535+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 msgr2=0x7f4edc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:30.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 0x7f4edc074600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80016c0 tx=0x7f4ee80a7040 comp rx=0 tx=0).stop 2024-08-31T12:21:30.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 msgr2=0x7f4f001f02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:30.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00117b0 tx=0x7f4ef0011c70 comp rx=0 tx=0).stop 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 shutdown_connections 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f4edc0720f0 0x7f4edc074600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f0014c5c0 0x7f4f0014c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f000c5570 0x7f4f0014f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 --2- 172.21.15.164:0/456635407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ee4004810 0x7f4f001f02f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 >> 172.21.15.164:0/456635407 conn(0x7f4f000ccf20 msgr2=0x7f4f0014fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 shutdown_connections 2024-08-31T12:21:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:30.539+0000 7f4f07200640 1 -- 172.21.15.164:0/456635407 wait complete. 2024-08-31T12:21:30.561 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "btime": "2024-08-31T12:21:30:391672+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 29, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-08-31T12:13:46.068757+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5274": { "addr": "172.21.15.164:6835/2530648468", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6834", "nonce": 2530648468, "type": "v2" }, { "addr": "172.21.15.164:6835", "nonce": 2530648468, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5274, "incarnation": 27, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 56, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-08-31T12:21:29.843343+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5274 } } } ], "standbys": [ { "addr": "172.21.15.184:6838/3699696204", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6835", "nonce": 3699696204, "type": "v2" }, { "addr": "172.21.15.184:6838", "nonce": 3699696204, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4304, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6839/3774379211", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 3774379211, "type": "v2" }, { "addr": "172.21.15.184:6839", "nonce": 3774379211, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4307, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6833/3562834666", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6832", "nonce": 3562834666, "type": "v2" }, { "addr": "172.21.15.164:6833", "nonce": 3562834666, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4317, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.164:6837/2838802595", "addrs": { "addrvec": [ { "addr": "172.21.15.164:6836", "nonce": 2838802595, "type": "v2" }, { "addr": "172.21.15.164:6837", "nonce": 2838802595, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4332, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-08-31T12:21:32.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- 172.21.15.164:0/3151947761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 msgr2=0x7f54dc0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- 172.21.15.164:0/3151947761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc0c9330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54dc072540 tx=0x7f54c401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- 172.21.15.164:0/3151947761 shutdown_connections 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- 172.21.15.164:0/3151947761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 0x7f54dc0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- 172.21.15.164:0/3151947761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc0c9330 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- 172.21.15.164:0/3151947761 >> v2:172.21.15.184:3300/0 conn(0x7f54dc15bc70 0x7f54dc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- 172.21.15.164:0/3151947761 >> 172.21.15.164:0/3151947761 conn(0x7f54dc0ccf20 msgr2=0x7f54dc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- 172.21.15.164:0/3151947761 shutdown_connections 2024-08-31T12:21:32.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- 172.21.15.164:0/3151947761 wait complete. 2024-08-31T12:21:32.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 Processor -- start 2024-08-31T12:21:32.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- start start 2024-08-31T12:21:32.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:32.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 0x7f54dc0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:32.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54dc15bc70 0x7f54dc14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0748a0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc074720 con 0x7f54dc15bc70 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.727+0000 7f54e1200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc074a20 con 0x7f54dc0c7920 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59588/0 (socket says 172.21.15.164:59588) 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 -- 172.21.15.164:0/1962465209 learned_addr learned my addr 172.21.15.164:0/1962465209 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d1400640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 0x7f54dc0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54da800640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54dc15bc70 0x7f54dc14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 -- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 msgr2=0x7f54dc0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 0x7f54dc0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 -- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54dc15bc70 msgr2=0x7f54dc14bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54dc15bc70 0x7f54dc14bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 -- 172.21.15.164:0/1962465209 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc14f570 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d9e00640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0058d0 tx=0x7f54cc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc017070 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54cc009cc0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc1f3750 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0106c0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc14efb0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc074f10 con 0x7f54dc0c1f40 2024-08-31T12:21:32.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.731+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f54cc01a070 con 0x7f54dc0c1f40 2024-08-31T12:21:32.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.735+0000 7f54d2a00640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 0x7f54b8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:32.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.735+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f54cc093270 con 0x7f54dc0c1f40 2024-08-31T12:21:32.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.735+0000 7f54d1400640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 0x7f54b8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:32.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.735+0000 7f54d1400640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 0x7f54b8074600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f54c40b2000 tx=0x7f54c401d8f0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:32.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.739+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f54cc05e5c0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54dc1560a0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54d2a00640 1 -- 172.21.15.164:0/1962465209 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6057 (secure 0 0 0) 0x7f54cc05dec0 con 0x7f54dc0c1f40 2024-08-31T12:21:32.943 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:32.943 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":29,"btime":"2024-08-31T12:21:30:391672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:29.843343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:32.943 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 29 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 msgr2=0x7f54b8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 0x7f54b8074600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f54c40b2000 tx=0x7f54c401d8f0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 msgr2=0x7f54dc1f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0058d0 tx=0x7f54cc00dde0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 shutdown_connections 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f54b80720f0 0x7f54b8074600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54dc15bc70 0x7f54dc14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54dc0c7920 0x7f54dc0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 --2- 172.21.15.164:0/1962465209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54dc0c1f40 0x7f54dc1f3210 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:32.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.939+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 >> 172.21.15.164:0/1962465209 conn(0x7f54dc0ccf20 msgr2=0x7f54dc150380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:32.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.943+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 shutdown_connections 2024-08-31T12:21:32.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:32.943+0000 7f54e1200640 1 -- 172.21.15.164:0/1962465209 wait complete. 2024-08-31T12:21:32.965 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:34.966 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:35.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 -- 172.21.15.164:0/1362031612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c158470 msgr2=0x7ff87c151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 --2- 172.21.15.164:0/1362031612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c158470 0x7ff87c151c30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0709e0 tx=0x7ff87401caf0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 -- 172.21.15.164:0/1362031612 shutdown_connections 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 --2- 172.21.15.164:0/1362031612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c158470 0x7ff87c151c30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 --2- 172.21.15.164:0/1362031612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c0b2fd0 0x7ff87c0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 --2- 172.21.15.164:0/1362031612 >> v2:172.21.15.184:3300/0 conn(0x7ff87c0c8b00 0x7ff87c0c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 -- 172.21.15.164:0/1362031612 >> 172.21.15.164:0/1362031612 conn(0x7ff87c0ccf20 msgr2=0x7ff87c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 -- 172.21.15.164:0/1362031612 shutdown_connections 2024-08-31T12:21:35.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.127+0000 7ff882400640 1 -- 172.21.15.164:0/1362031612 wait complete. 2024-08-31T12:21:35.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 Processor -- start 2024-08-31T12:21:35.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- start start 2024-08-31T12:21:35.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:35.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff87c0c8b00 0x7ff87c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c158470 0x7ff87c14a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c15b330 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c15b1b0 con 0x7ff87c0c8b00 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c15b4b0 con 0x7ff87c158470 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59616/0 (socket says 172.21.15.164:59616) 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 -- 172.21.15.164:0/3775844311 learned_addr learned my addr 172.21.15.164:0/3775844311 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87be00640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c158470 0x7ff87c14a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff872a00640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff87c0c8b00 0x7ff87c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 -- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c158470 msgr2=0x7ff87c14a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c158470 0x7ff87c14a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 -- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff87c0c8b00 msgr2=0x7ff87c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:35.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff87c0c8b00 0x7ff87c158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 -- 172.21.15.164:0/3775844311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c1f5c80 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff87b400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c940 tx=0x7ff86c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:35.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c004220 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c0079b0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c0c69d0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0044b0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.131+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c0c6f90 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.135+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c0c22b0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.135+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff86c003600 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.135+0000 7ff873e00640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 0x7ff8580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:35.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.135+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7ff86c0934f0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.135+0000 7ff872a00640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 0x7ff8580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:35.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.139+0000 7ff872a00640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 0x7ff8580745d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff864005fd0 tx=0x7ff864005d80 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:35.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.139+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff86c014030 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.339+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff87c14f680 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.339+0000 7ff873e00640 1 -- 172.21.15.164:0/3775844311 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6057 (secure 0 0 0) 0x7ff86c05e8d0 con 0x7ff87c0b2fd0 2024-08-31T12:21:35.344 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:35.344 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":29,"btime":"2024-08-31T12:21:30:391672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:29.843343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T12:21:35.344 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 29 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 msgr2=0x7ff8580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 0x7ff8580745d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff864005fd0 tx=0x7ff864005d80 comp rx=0 tx=0).stop 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 msgr2=0x7ff87c1f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c940 tx=0x7ff86c00ce00 comp rx=0 tx=0).stop 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 shutdown_connections 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff8580720c0 0x7ff8580745d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff87c158470 0x7ff87c14a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff87c0c8b00 0x7ff87c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 --2- 172.21.15.164:0/3775844311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff87c0b2fd0 0x7ff87c1f5740 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:35.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 >> 172.21.15.164:0/3775844311 conn(0x7ff87c0ccf20 msgr2=0x7ff87c074ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:35.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 shutdown_connections 2024-08-31T12:21:35.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:35.343+0000 7ff882400640 1 -- 172.21.15.164:0/3775844311 wait complete. 2024-08-31T12:21:35.365 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-08-31T12:21:36.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:21:36.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:21:37.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 -- 172.21.15.164:0/309087968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 msgr2=0x7f7c30004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 --2- 172.21.15.164:0/309087968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c30004810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400c310 tx=0x7f7c3401cf60 comp rx=0 tx=0).stop 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c4e000640 1 -- 172.21.15.164:0/309087968 reap_dead start 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 -- 172.21.15.164:0/309087968 shutdown_connections 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 -- 172.21.15.164:0/309087968 >> 172.21.15.164:0/309087968 conn(0x7f7c480ccf20 msgr2=0x7f7c480cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 -- 172.21.15.164:0/309087968 shutdown_connections 2024-08-31T12:21:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.527+0000 7f7c50000640 1 -- 172.21.15.164:0/309087968 wait complete. 2024-08-31T12:21:37.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 Processor -- start 2024-08-31T12:21:37.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- start start 2024-08-31T12:21:37.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4814f730 0x7f7c48073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4814fb40 0x7f7c48073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7c48074e30 con 0x7f7c30004010 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7c480c8030 con 0x7f7c4814f730 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f7c48074fb0 con 0x7f7c4814fb40 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37436/0 (socket says 172.21.15.164:37436) 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 -- 172.21.15.164:0/1075950712 learned_addr learned my addr 172.21.15.164:0/1075950712 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4e000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4814fb40 0x7f7c48073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4cc00640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4814f730 0x7f7c48073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 -- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4814fb40 msgr2=0x7f7c48073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4814fb40 0x7f7c48073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 -- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4814f730 msgr2=0x7f7c48073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4814f730 0x7f7c48073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 -- 172.21.15.164:0/1075950712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c481f2ec0 con 0x7f7c30004010 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c4d600640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004f40 tx=0x7f7c3c0016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c015020 con 0x7f7c30004010 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c3c011960 con 0x7f7c30004010 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4815ab00 con 0x7f7c30004010 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011d90 con 0x7f7c30004010 2024-08-31T12:21:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.531+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4815aed0 con 0x7f7c30004010 2024-08-31T12:21:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c480c9330 con 0x7f7c30004010 2024-08-31T12:21:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7c3c018020 con 0x7f7c30004010 2024-08-31T12:21:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c45600640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 0x7f7c280745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f7c3c093b10 con 0x7f7c30004010 2024-08-31T12:21:37.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c4cc00640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 0x7f7c280745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:37.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.535+0000 7f7c4cc00640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 0x7f7c280745d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c340ac000 tx=0x7f7c34019da0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.539+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7c3c01f020 con 0x7f7c30004010 2024-08-31T12:21:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.743+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c48151380 con 0x7f7c30004010 2024-08-31T12:21:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.743+0000 7f7c45600640 1 -- 172.21.15.164:0/1075950712 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6064 (secure 0 0 0) 0x7f7c3c05ef80 con 0x7f7c30004010 2024-08-31T12:21:37.748 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:37.748 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":30,"btime":"2024-08-31T12:21:35:831353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:35.831348+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5274,"qdb_cluster":[5274]},"id":1}]} 2024-08-31T12:21:37.748 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 30 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 msgr2=0x7f7c280745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 0x7f7c280745d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c340ac000 tx=0x7f7c34019da0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 msgr2=0x7f7c481f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004f40 tx=0x7f7c3c0016a0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 shutdown_connections 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f7c280720c0 0x7f7c280745d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4814fb40 0x7f7c48073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4814f730 0x7f7c48073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 --2- 172.21.15.164:0/1075950712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c30004010 0x7f7c481f2980 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:37.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 >> 172.21.15.164:0/1075950712 conn(0x7f7c480ccf20 msgr2=0x7f7c480b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:37.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 shutdown_connections 2024-08-31T12:21:37.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:37.747+0000 7f7c50000640 1 -- 172.21.15.164:0/1075950712 wait complete. 2024-08-31T12:21:37.770 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=0, replacing gid=5125 2024-08-31T12:21:37.770 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 7 secs before reviving mds.d 2024-08-31T12:21:42.070 INFO:tasks.workunit.client.0.smithi164.stderr:error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. 2024-08-31T12:21:42.070 INFO:tasks.workunit.client.0.smithi164.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2024-08-31T12:21:42.074 INFO:tasks.workunit.client.0.smithi164.stderr:fatal: early EOF 2024-08-31T12:21:42.074 INFO:tasks.workunit.client.0.smithi164.stderr:fatal: fetch-pack: invalid index-pack output 2024-08-31T12:21:42.788 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-08-31T12:21:42.788 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-08-31T12:21:42.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T12:21:43.791 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi164 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-08-31T12:21:44.022 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fd7e59ff1765442eb737865420c640f9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi164 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-08-31T12:21:44.024 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-08-31T12:21:44.032 INFO:tasks.mds_thrash:joining mds_thrasher 2024-08-31T12:21:44.035 ERROR:tasks.mds_thrash.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/mds_thrash.py", line 314, in do_thrash self.sleep_unless_stopped(delay) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T12:21:44.039 INFO:tasks.mds_thrash:done joining 2024-08-31T12:21:44.039 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-31T12:21:44.048 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T12:21:44.049 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:21:44.049 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:21:44.057 INFO:tasks.ceph.mds.a.smithi164.stderr:2024-08-31T12:21:43.819+0000 7f4278800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:21:44.066 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-08-31T12:21:44.066 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:21:44.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T12:21:44.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 -- 172.21.15.164:0/489037074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440015bc70 msgr2=0x7f4400152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 --2- 172.21.15.164:0/489037074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440015bc70 0x7f4400152a10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4400070b70 tx=0x7f43f401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 -- 172.21.15.164:0/489037074 shutdown_connections 2024-08-31T12:21:44.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 --2- 172.21.15.164:0/489037074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 0x7f44000c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 --2- 172.21.15.164:0/489037074 >> v2:172.21.15.184:3300/0 conn(0x7f44000c1f40 0x7f44000c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 --2- 172.21.15.164:0/489037074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440015bc70 0x7f4400152a10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 -- 172.21.15.164:0/489037074 >> 172.21.15.164:0/489037074 conn(0x7f44000ccf20 msgr2=0x7f44000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 -- 172.21.15.164:0/489037074 shutdown_connections 2024-08-31T12:21:44.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.311+0000 7f4408000640 1 -- 172.21.15.164:0/489037074 wait complete. 2024-08-31T12:21:44.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 Processor -- start 2024-08-31T12:21:44.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- start start 2024-08-31T12:21:44.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 0x7f44000c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f440015bc70 0x7f44000c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f44000748a0 con 0x7f44000c1f40 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4400074720 con 0x7f440015bc70 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4400074a20 con 0x7f44000c7920 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37460/0 (socket says 172.21.15.164:37460) 2024-08-31T12:21:44.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 -- 172.21.15.164:0/3870539974 learned_addr learned my addr 172.21.15.164:0/3870539974 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4404c00640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 0x7f44000c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4406000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f440015bc70 0x7f44000c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 -- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 msgr2=0x7f44000c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 0x7f44000c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 -- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f440015bc70 msgr2=0x7f44000c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f440015bc70 0x7f44000c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 -- 172.21.15.164:0/3870539974 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44001f2540 con 0x7f44000c1f40 2024-08-31T12:21:44.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4405600640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43f401d760 tx=0x7f43f4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40bd020 con 0x7f44000c1f40 2024-08-31T12:21:44.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43f4005120 con 0x7f44000c1f40 2024-08-31T12:21:44.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40b5040 con 0x7f44000c1f40 2024-08-31T12:21:44.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44001f5840 con 0x7f44000c1f40 2024-08-31T12:21:44.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44001f5e00 con 0x7f44000c1f40 2024-08-31T12:21:44.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.315+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4400074ea0 con 0x7f44000c1f40 2024-08-31T12:21:44.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.319+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f43f40046d0 con 0x7f44000c1f40 2024-08-31T12:21:44.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.319+0000 7f43fd600640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 0x7f43e00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.319+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f43f4130550 con 0x7f44000c1f40 2024-08-31T12:21:44.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.319+0000 7f4404c00640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 0x7f43e00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.319+0000 7f4404c00640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 0x7f43e00745d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f440015bbd0 tx=0x7f43ec0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.323+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f43f40c8080 con 0x7f44000c1f40 2024-08-31T12:21:44.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.507+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44000c82f0 con 0x7f44000c1f40 2024-08-31T12:21:44.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.507+0000 7f43fd600640 1 -- 172.21.15.164:0/3870539974 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v56) ==== 80+0+494 (secure 0 0 0) 0x7f43f4102e20 con 0x7f44000c1f40 2024-08-31T12:21:44.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.184:6834/4233946054 2024-09-01T12:21:16.365631+0000 2024-08-31T12:21:44.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.184:6837/4233946054 2024-09-01T12:21:16.365631+0000 2024-08-31T12:21:44.511 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6835/580774116 2024-09-01T12:20:26.356943+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6834/580774116 2024-09-01T12:20:26.356943+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.184:6837/1093030453 2024-09-01T12:19:21.343788+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.184:6834/1093030453 2024-09-01T12:19:21.343788+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6835/2031819890 2024-09-01T12:16:31.307712+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6834/2031819890 2024-09-01T12:16:31.307712+0000 2024-08-31T12:21:44.512 INFO:teuthology.orchestra.run.smithi164.stderr:listed 8 entries 2024-08-31T12:21:44.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 msgr2=0x7f43e00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 0x7f43e00745d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f440015bbd0 tx=0x7f43ec0091e0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 msgr2=0x7f44001e2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43f401d760 tx=0x7f43f4005780 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 shutdown_connections 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f43e00720c0 0x7f43e00745d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f440015bc70 0x7f44000c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44000c7920 0x7f44000c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 --2- 172.21.15.164:0/3870539974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44000c1f40 0x7f44001e2a20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 >> 172.21.15.164:0/3870539974 conn(0x7f44000ccf20 msgr2=0x7f4400151730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 shutdown_connections 2024-08-31T12:21:44.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:44.511+0000 7f4408000640 1 -- 172.21.15.164:0/3870539974 wait complete. 2024-08-31T12:21:44.534 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-31T12:21:44.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:21:44.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-31T12:21:44.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:21:44.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:21:44.653 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T12:21:44.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:21:44.681 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-08-31T12:21:44.733 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T12:21:44.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:21:44.734 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:21:44.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:21:44.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-08-31T12:21:45.339 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-31T12:21:45.348 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T12:21:45.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 -- 172.21.15.164:0/681570163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 msgr2=0x7fce500c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 --2- 172.21.15.164:0/681570163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce500c7920 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fce38009900 tx=0x7fce3801c8e0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 -- 172.21.15.164:0/681570163 shutdown_connections 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 --2- 172.21.15.164:0/681570163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce500c7920 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 --2- 172.21.15.164:0/681570163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce500c8b00 0x7fce500c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 -- 172.21.15.164:0/681570163 >> 172.21.15.164:0/681570163 conn(0x7fce500ccf20 msgr2=0x7fce500cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:45.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 -- 172.21.15.164:0/681570163 shutdown_connections 2024-08-31T12:21:45.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.499+0000 7fce57800640 1 -- 172.21.15.164:0/681570163 wait complete. 2024-08-31T12:21:45.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 Processor -- start 2024-08-31T12:21:45.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- start start 2024-08-31T12:21:45.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce500c8b00 0x7fce500cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce50158470 0x7fce50144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fce501626c0 con 0x7fce500b2fd0 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fce50162540 con 0x7fce500c8b00 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fce50162840 con 0x7fce50158470 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47298/0 (socket says 172.21.15.164:47298) 2024-08-31T12:21:45.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 -- 172.21.15.164:0/3256443132 learned_addr learned my addr 172.21.15.164:0/3256443132 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce47e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce500c8b00 0x7fce500cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce55800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce50158470 0x7fce50144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 -- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce50158470 msgr2=0x7fce50144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce50158470 0x7fce50144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 -- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce500c8b00 msgr2=0x7fce500cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce500c8b00 0x7fce500cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 -- 172.21.15.164:0/3256443132 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500c2620 con 0x7fce500b2fd0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce54e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fce4000d950 tx=0x7fce4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40017070 con 0x7fce500b2fd0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce40009d20 con 0x7fce500b2fd0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce400106c0 con 0x7fce500b2fd0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce501464a0 con 0x7fce500b2fd0 2024-08-31T12:21:45.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.503+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce501f91c0 con 0x7fce500b2fd0 2024-08-31T12:21:45.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.507+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce500c7920 con 0x7fce500b2fd0 2024-08-31T12:21:45.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.507+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fce4001a070 con 0x7fce500b2fd0 2024-08-31T12:21:45.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.507+0000 7fce4d600640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 0x7fce2c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.507+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fce400931f0 con 0x7fce500b2fd0 2024-08-31T12:21:45.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.507+0000 7fce47e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 0x7fce2c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.511+0000 7fce47e00640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 0x7fce2c0745d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce380af000 tx=0x7fce3801b120 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.511+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fce4005e610 con 0x7fce500b2fd0 2024-08-31T12:21:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.679+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce500c9eb0 con 0x7fce2c0720c0 2024-08-31T12:21:45.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.695+0000 7fce4d600640 1 -- 172.21.15.164:0/3256443132 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336098 (secure 0 0 0) 0x7fce3810e100 con 0x7fce2c0720c0 2024-08-31T12:21:45.703 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 msgr2=0x7fce2c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 0x7fce2c0745d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce380af000 tx=0x7fce3801b120 comp rx=0 tx=0).stop 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 msgr2=0x7fce50145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fce4000d950 tx=0x7fce4000de10 comp rx=0 tx=0).stop 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 shutdown_connections 2024-08-31T12:21:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fce2c0720c0 0x7fce2c0745d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce50158470 0x7fce50144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce500c8b00 0x7fce500cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 --2- 172.21.15.164:0/3256443132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce500b2fd0 0x7fce50145f60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 >> 172.21.15.164:0/3256443132 conn(0x7fce500ccf20 msgr2=0x7fce50162ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 shutdown_connections 2024-08-31T12:21:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.699+0000 7fce57800640 1 -- 172.21.15.164:0/3256443132 wait complete. 2024-08-31T12:21:45.725 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-08-31T12:21:44.755442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":493237252,"num_objects":166,"num_object_clones":0,"num_object_copies":544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":1674,"num_read_kb":531904,"num_write":15310,"num_write_kb":686158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20432,"ondisk_log_size":20432,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1688132,"kb_used_data":990276,"kb_used_omap":12,"kb_used_meta":697715,"kb_avail":753286588,"statfs":{"total":773094113280,"available":771365466112,"internally_reserved":0,"allocated":1014042624,"data_stored":1011534289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":714460721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-66121297,"num_objects":-17,"num_object_clones":0,"num_object_copies":-68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":78,"num_write_kb":828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006353"},"pg_stats":[{"pgid":"2.1f","version":"56'59","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.855289+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:21:23.855289+0000","last_peered":"2024-08-31T12:21:23.855289+0000","last_clean":"2024-08-31T12:21:23.855289+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:23.855289+0000","last_undegraded":"2024-08-31T12:21:23.855289+0000","last_fullsized":"2024-08-31T12:21:23.855289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"43'87","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074630+0000","last_change":"2024-08-31T12:19:51.077673+0000","last_active":"2024-08-31T12:21:17.074630+0000","last_peered":"2024-08-31T12:21:17.074630+0000","last_clean":"2024-08-31T12:21:17.074630+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:17.074630+0000","last_undegraded":"2024-08-31T12:21:17.074630+0000","last_fullsized":"2024-08-31T12:21:17.074630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:27.050879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"55'363","reported_seq":2506,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:50.981608+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:24:47.867907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":360,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"55'81","reported_seq":171,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074838+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:21:17.074838+0000","last_peered":"2024-08-31T12:21:17.074838+0000","last_clean":"2024-08-31T12:21:17.074838+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:21:17.074838+0000","last_undegraded":"2024-08-31T12:21:17.074838+0000","last_fullsized":"2024-08-31T12:21:17.074838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"47'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.075830+0000","last_change":"2024-08-31T12:19:51.078041+0000","last_active":"2024-08-31T12:21:17.075830+0000","last_peered":"2024-08-31T12:21:17.075830+0000","last_clean":"2024-08-31T12:21:17.075830+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:21:17.075830+0000","last_undegraded":"2024-08-31T12:21:17.075830+0000","last_fullsized":"2024-08-31T12:21:17.075830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:40.429055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'344","reported_seq":2486,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068332+0000","last_change":"2024-08-31T12:19:51.270521+0000","last_active":"2024-08-31T12:21:17.068332+0000","last_peered":"2024-08-31T12:21:17.068332+0000","last_clean":"2024-08-31T12:21:17.068332+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:21:17.068332+0000","last_undegraded":"2024-08-31T12:21:17.068332+0000","last_fullsized":"2024-08-31T12:21:17.068332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:42:30.397283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":343,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1937","reported_seq":2035,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.403350+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:21:21.403350+0000","last_peered":"2024-08-31T12:21:21.403350+0000","last_clean":"2024-08-31T12:21:21.403350+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:21:21.403350+0000","last_undegraded":"2024-08-31T12:21:21.403350+0000","last_fullsized":"2024-08-31T12:21:21.403350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":38900,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"53'81","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070461+0000","last_change":"2024-08-31T12:19:51.222939+0000","last_active":"2024-08-31T12:21:17.070461+0000","last_peered":"2024-08-31T12:21:17.070461+0000","last_clean":"2024-08-31T12:21:17.070461+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:17.070461+0000","last_undegraded":"2024-08-31T12:21:17.070461+0000","last_fullsized":"2024-08-31T12:21:17.070461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:45.439283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"55'365","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.265557+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:34.207533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":364,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"55'49","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971951+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:21:16.971951+0000","last_peered":"2024-08-31T12:21:16.971951+0000","last_clean":"2024-08-31T12:21:16.971951+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:16.971951+0000","last_undegraded":"2024-08-31T12:21:16.971951+0000","last_fullsized":"2024-08-31T12:21:16.971951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372884+0000","last_change":"2024-08-31T12:19:51.191343+0000","last_active":"2024-08-31T12:21:16.372884+0000","last_peered":"2024-08-31T12:21:16.372884+0000","last_clean":"2024-08-31T12:21:16.372884+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:21:16.372884+0000","last_undegraded":"2024-08-31T12:21:16.372884+0000","last_fullsized":"2024-08-31T12:21:16.372884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:55.638854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"55'331","reported_seq":2474,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068734+0000","last_change":"2024-08-31T12:19:51.266908+0000","last_active":"2024-08-31T12:21:17.068734+0000","last_peered":"2024-08-31T12:21:17.068734+0000","last_clean":"2024-08-31T12:21:17.068734+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:21:17.068734+0000","last_undegraded":"2024-08-31T12:21:17.068734+0000","last_fullsized":"2024-08-31T12:21:17.068734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:53.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":331,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372070+0000","last_change":"2024-08-31T12:19:51.182717+0000","last_active":"2024-08-31T12:21:16.372070+0000","last_peered":"2024-08-31T12:21:16.372070+0000","last_clean":"2024-08-31T12:21:16.372070+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:16.372070+0000","last_undegraded":"2024-08-31T12:21:16.372070+0000","last_fullsized":"2024-08-31T12:21:16.372070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:02:01.902388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"55'85","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.385266+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:21:21.385266+0000","last_peered":"2024-08-31T12:21:21.385266+0000","last_clean":"2024-08-31T12:21:21.385266+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:21.385266+0000","last_undegraded":"2024-08-31T12:21:21.385266+0000","last_fullsized":"2024-08-31T12:21:21.385266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'335","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970562+0000","last_change":"2024-08-31T12:19:50.893218+0000","last_active":"2024-08-31T12:21:16.970562+0000","last_peered":"2024-08-31T12:21:16.970562+0000","last_clean":"2024-08-31T12:21:16.970562+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:21:16.970562+0000","last_undegraded":"2024-08-31T12:21:16.970562+0000","last_fullsized":"2024-08-31T12:21:16.970562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:26.717821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":334,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'80","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.379462+0000","last_change":"2024-08-31T12:19:50.981970+0000","last_active":"2024-08-31T12:21:16.379462+0000","last_peered":"2024-08-31T12:21:16.379462+0000","last_clean":"2024-08-31T12:21:16.379462+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:16.379462+0000","last_undegraded":"2024-08-31T12:21:16.379462+0000","last_fullsized":"2024-08-31T12:21:16.379462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:50:55.324238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"42'23","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815017+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:21:16.815017+0000","last_peered":"2024-08-31T12:21:16.815017+0000","last_clean":"2024-08-31T12:21:16.815017+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:16.815017+0000","last_undegraded":"2024-08-31T12:21:16.815017+0000","last_fullsized":"2024-08-31T12:21:16.815017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"55'362","reported_seq":2505,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970380+0000","last_change":"2024-08-31T12:19:50.893757+0000","last_active":"2024-08-31T12:21:16.970380+0000","last_peered":"2024-08-31T12:21:16.970380+0000","last_clean":"2024-08-31T12:21:16.970380+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:21:16.970380+0000","last_undegraded":"2024-08-31T12:21:16.970380+0000","last_fullsized":"2024-08-31T12:21:16.970380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:38:01.625027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":359,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373448+0000","last_change":"2024-08-31T12:19:51.043981+0000","last_active":"2024-08-31T12:21:16.373448+0000","last_peered":"2024-08-31T12:21:16.373448+0000","last_clean":"2024-08-31T12:21:16.373448+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:21:16.373448+0000","last_undegraded":"2024-08-31T12:21:16.373448+0000","last_fullsized":"2024-08-31T12:21:16.373448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:13.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'86","reported_seq":172,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.779627+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:21:42.779627+0000","last_peered":"2024-08-31T12:21:42.779627+0000","last_clean":"2024-08-31T12:21:42.779627+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:21:42.779627+0000","last_undegraded":"2024-08-31T12:21:42.779627+0000","last_fullsized":"2024-08-31T12:21:42.779627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307770,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":82,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'335","reported_seq":2485,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380280+0000","last_change":"2024-08-31T12:19:50.982738+0000","last_active":"2024-08-31T12:21:16.380280+0000","last_peered":"2024-08-31T12:21:16.380280+0000","last_clean":"2024-08-31T12:21:16.380280+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:16.380280+0000","last_undegraded":"2024-08-31T12:21:16.380280+0000","last_fullsized":"2024-08-31T12:21:16.380280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:27:32.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":8232,"num_write":331,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"53'92","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371986+0000","last_change":"2024-08-31T12:19:51.179971+0000","last_active":"2024-08-31T12:21:16.371986+0000","last_peered":"2024-08-31T12:21:16.371986+0000","last_clean":"2024-08-31T12:21:16.371986+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:16.371986+0000","last_undegraded":"2024-08-31T12:21:16.371986+0000","last_fullsized":"2024-08-31T12:21:16.371986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:49:48.420577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'8","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970212+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:21:16.970212+0000","last_peered":"2024-08-31T12:21:16.970212+0000","last_clean":"2024-08-31T12:21:16.970212+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:16.970212+0000","last_undegraded":"2024-08-31T12:21:16.970212+0000","last_fullsized":"2024-08-31T12:21:16.970212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"55'281","reported_seq":2426,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069212+0000","last_change":"2024-08-31T12:19:51.271430+0000","last_active":"2024-08-31T12:21:17.069212+0000","last_peered":"2024-08-31T12:21:17.069212+0000","last_clean":"2024-08-31T12:21:17.069212+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:17.069212+0000","last_undegraded":"2024-08-31T12:21:17.069212+0000","last_fullsized":"2024-08-31T12:21:17.069212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:12.164256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":279,"num_write_kb":16521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.383778+0000","last_change":"2024-08-31T12:19:51.049750+0000","last_active":"2024-08-31T12:21:16.383778+0000","last_peered":"2024-08-31T12:21:16.383778+0000","last_clean":"2024-08-31T12:21:16.383778+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:16.383778+0000","last_undegraded":"2024-08-31T12:21:16.383778+0000","last_fullsized":"2024-08-31T12:21:16.383778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:52.154694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'8","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.852975+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:21:23.852975+0000","last_peered":"2024-08-31T12:21:23.852975+0000","last_clean":"2024-08-31T12:21:23.852975+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:23.852975+0000","last_undegraded":"2024-08-31T12:21:23.852975+0000","last_fullsized":"2024-08-31T12:21:23.852975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'356","reported_seq":2492,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068333+0000","last_change":"2024-08-31T12:19:51.267348+0000","last_active":"2024-08-31T12:21:17.068333+0000","last_peered":"2024-08-31T12:21:17.068333+0000","last_clean":"2024-08-31T12:21:17.068333+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:17.068333+0000","last_undegraded":"2024-08-31T12:21:17.068333+0000","last_fullsized":"2024-08-31T12:21:17.068333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:52:51.279879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":20972894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":354,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"55'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.382991+0000","last_change":"2024-08-31T12:19:51.047806+0000","last_active":"2024-08-31T12:21:16.382991+0000","last_peered":"2024-08-31T12:21:16.382991+0000","last_clean":"2024-08-31T12:21:16.382991+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:16.382991+0000","last_undegraded":"2024-08-31T12:21:16.382991+0000","last_fullsized":"2024-08-31T12:21:16.382991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:27:44.404451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'168","reported_seq":258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.852923+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:21:41.852923+0000","last_peered":"2024-08-31T12:21:41.852923+0000","last_clean":"2024-08-31T12:21:41.852923+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:41.852923+0000","last_undegraded":"2024-08-31T12:21:41.852923+0000","last_fullsized":"2024-08-31T12:21:41.852923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":409,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'357","reported_seq":2514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.920444+0000","last_change":"2024-08-31T12:19:51.044689+0000","last_active":"2024-08-31T12:21:42.920444+0000","last_peered":"2024-08-31T12:21:42.920444+0000","last_clean":"2024-08-31T12:21:42.920444+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:21:42.920444+0000","last_undegraded":"2024-08-31T12:21:42.920444+0000","last_fullsized":"2024-08-31T12:21:42.920444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:00:11.862454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":1492,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":355,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"43'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815142+0000","last_change":"2024-08-31T12:19:51.184067+0000","last_active":"2024-08-31T12:21:16.815142+0000","last_peered":"2024-08-31T12:21:16.815142+0000","last_clean":"2024-08-31T12:21:16.815142+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:16.815142+0000","last_undegraded":"2024-08-31T12:21:16.815142+0000","last_fullsized":"2024-08-31T12:21:16.815142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:03.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"42'21","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373694+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:21:16.373694+0000","last_peered":"2024-08-31T12:21:16.373694+0000","last_clean":"2024-08-31T12:21:16.373694+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:16.373694+0000","last_undegraded":"2024-08-31T12:21:16.373694+0000","last_fullsized":"2024-08-31T12:21:16.373694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'367","reported_seq":2507,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.787456+0000","last_change":"2024-08-31T12:19:51.178915+0000","last_active":"2024-08-31T12:21:26.787456+0000","last_peered":"2024-08-31T12:21:26.787456+0000","last_clean":"2024-08-31T12:21:26.787456+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:21:26.787456+0000","last_undegraded":"2024-08-31T12:21:26.787456+0000","last_fullsized":"2024-08-31T12:21:26.787456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:55.684998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":20971859,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":367,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"43'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.267618+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:57.623085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072705+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:21:17.072705+0000","last_peered":"2024-08-31T12:21:17.072705+0000","last_clean":"2024-08-31T12:21:17.072705+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:17.072705+0000","last_undegraded":"2024-08-31T12:21:17.072705+0000","last_fullsized":"2024-08-31T12:21:17.072705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'351","reported_seq":2493,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812483+0000","last_change":"2024-08-31T12:19:51.175945+0000","last_active":"2024-08-31T12:21:16.812483+0000","last_peered":"2024-08-31T12:21:16.812483+0000","last_clean":"2024-08-31T12:21:16.812483+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:21:16.812483+0000","last_undegraded":"2024-08-31T12:21:16.812483+0000","last_fullsized":"2024-08-31T12:21:16.812483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:03:44.835939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":4199202,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":350,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"53'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970407+0000","last_change":"2024-08-31T12:19:50.892454+0000","last_active":"2024-08-31T12:21:16.970407+0000","last_peered":"2024-08-31T12:21:16.970407+0000","last_clean":"2024-08-31T12:21:16.970407+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:16.970407+0000","last_undegraded":"2024-08-31T12:21:16.970407+0000","last_fullsized":"2024-08-31T12:21:16.970407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:35:26.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'167","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.582813+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:21:21.582813+0000","last_peered":"2024-08-31T12:21:21.582813+0000","last_clean":"2024-08-31T12:21:21.582813+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:21.582813+0000","last_undegraded":"2024-08-31T12:21:21.582813+0000","last_fullsized":"2024-08-31T12:21:21.582813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'317","reported_seq":2452,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814080+0000","last_change":"2024-08-31T12:19:51.183892+0000","last_active":"2024-08-31T12:21:16.814080+0000","last_peered":"2024-08-31T12:21:16.814080+0000","last_clean":"2024-08-31T12:21:16.814080+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:21:16.814080+0000","last_undegraded":"2024-08-31T12:21:16.814080+0000","last_fullsized":"2024-08-31T12:21:16.814080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:30.314422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":8393263,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3300,"num_write":317,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071145+0000","last_change":"2024-08-31T12:19:51.049351+0000","last_active":"2024-08-31T12:21:17.071145+0000","last_peered":"2024-08-31T12:21:17.071145+0000","last_clean":"2024-08-31T12:21:17.071145+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:17.071145+0000","last_undegraded":"2024-08-31T12:21:17.071145+0000","last_fullsized":"2024-08-31T12:21:17.071145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:40.766633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"55'141","reported_seq":366,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.378461+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:21:16.378461+0000","last_peered":"2024-08-31T12:21:16.378461+0000","last_clean":"2024-08-31T12:21:16.378461+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:16.378461+0000","last_undegraded":"2024-08-31T12:21:16.378461+0000","last_fullsized":"2024-08-31T12:21:16.378461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575283,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":654,"num_write":137,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"55'330","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814058+0000","last_change":"2024-08-31T12:19:51.184441+0000","last_active":"2024-08-31T12:21:16.814058+0000","last_peered":"2024-08-31T12:21:16.814058+0000","last_clean":"2024-08-31T12:21:16.814058+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:21:16.814058+0000","last_undegraded":"2024-08-31T12:21:16.814058+0000","last_fullsized":"2024-08-31T12:21:16.814058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:55:53.475438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":329,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"52'77","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812314+0000","last_change":"2024-08-31T12:19:51.182725+0000","last_active":"2024-08-31T12:21:16.812314+0000","last_peered":"2024-08-31T12:21:16.812314+0000","last_clean":"2024-08-31T12:21:16.812314+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:16.812314+0000","last_undegraded":"2024-08-31T12:21:16.812314+0000","last_fullsized":"2024-08-31T12:21:16.812314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:17:40.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'101","reported_seq":192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.798818+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:21:21.798818+0000","last_peered":"2024-08-31T12:21:21.798818+0000","last_clean":"2024-08-31T12:21:21.798818+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:21:21.798818+0000","last_undegraded":"2024-08-31T12:21:21.798818+0000","last_fullsized":"2024-08-31T12:21:21.798818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072317+0000","last_change":"2024-08-31T12:19:51.075766+0000","last_active":"2024-08-31T12:21:17.072317+0000","last_peered":"2024-08-31T12:21:17.072317+0000","last_clean":"2024-08-31T12:21:17.072317+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:21:17.072317+0000","last_undegraded":"2024-08-31T12:21:17.072317+0000","last_fullsized":"2024-08-31T12:21:17.072317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:27.063933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"55'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375625+0000","last_change":"2024-08-31T12:19:51.049809+0000","last_active":"2024-08-31T12:21:16.375625+0000","last_peered":"2024-08-31T12:21:16.375625+0000","last_clean":"2024-08-31T12:21:16.375625+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:16.375625+0000","last_undegraded":"2024-08-31T12:21:16.375625+0000","last_fullsized":"2024-08-31T12:21:16.375625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:03:05.060570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372650+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:21:16.372650+0000","last_peered":"2024-08-31T12:21:16.372650+0000","last_clean":"2024-08-31T12:21:16.372650+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:16.372650+0000","last_undegraded":"2024-08-31T12:21:16.372650+0000","last_fullsized":"2024-08-31T12:21:16.372650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069904+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:21:17.069904+0000","last_peered":"2024-08-31T12:21:17.069904+0000","last_clean":"2024-08-31T12:21:17.069904+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:17.069904+0000","last_undegraded":"2024-08-31T12:21:17.069904+0000","last_fullsized":"2024-08-31T12:21:17.069904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'297","reported_seq":2436,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373348+0000","last_change":"2024-08-31T12:19:51.191472+0000","last_active":"2024-08-31T12:21:16.373348+0000","last_peered":"2024-08-31T12:21:16.373348+0000","last_clean":"2024-08-31T12:21:16.373348+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:21:16.373348+0000","last_undegraded":"2024-08-31T12:21:16.373348+0000","last_fullsized":"2024-08-31T12:21:16.373348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:24.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":296,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"43'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373325+0000","last_change":"2024-08-31T12:19:51.189350+0000","last_active":"2024-08-31T12:21:16.373325+0000","last_peered":"2024-08-31T12:21:16.373325+0000","last_clean":"2024-08-31T12:21:16.373325+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:16.373325+0000","last_undegraded":"2024-08-31T12:21:16.373325+0000","last_fullsized":"2024-08-31T12:21:16.373325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:23.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815807+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:21:16.815807+0000","last_peered":"2024-08-31T12:21:16.815807+0000","last_clean":"2024-08-31T12:21:16.815807+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:16.815807+0000","last_undegraded":"2024-08-31T12:21:16.815807+0000","last_fullsized":"2024-08-31T12:21:16.815807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'342","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069573+0000","last_change":"2024-08-31T12:19:51.265682+0000","last_active":"2024-08-31T12:21:17.069573+0000","last_peered":"2024-08-31T12:21:17.069573+0000","last_clean":"2024-08-31T12:21:17.069573+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:21:17.069573+0000","last_undegraded":"2024-08-31T12:21:17.069573+0000","last_fullsized":"2024-08-31T12:21:17.069573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:39.107402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":8388848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":341,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"53'91","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971618+0000","last_change":"2024-08-31T12:19:50.894692+0000","last_active":"2024-08-31T12:21:16.971618+0000","last_peered":"2024-08-31T12:21:16.971618+0000","last_clean":"2024-08-31T12:21:16.971618+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:16.971618+0000","last_undegraded":"2024-08-31T12:21:16.971618+0000","last_fullsized":"2024-08-31T12:21:16.971618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:20.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"42'21","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375268+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:21:21.375268+0000","last_peered":"2024-08-31T12:21:21.375268+0000","last_clean":"2024-08-31T12:21:21.375268+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:21.375268+0000","last_undegraded":"2024-08-31T12:21:21.375268+0000","last_fullsized":"2024-08-31T12:21:21.375268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'321","reported_seq":2466,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071963+0000","last_change":"2024-08-31T12:19:51.075472+0000","last_active":"2024-08-31T12:21:17.071963+0000","last_peered":"2024-08-31T12:21:17.071963+0000","last_clean":"2024-08-31T12:21:17.071963+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:21:17.071963+0000","last_undegraded":"2024-08-31T12:21:17.071963+0000","last_fullsized":"2024-08-31T12:21:17.071963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:35.585043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":8388797,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":321,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971192+0000","last_change":"2024-08-31T12:19:50.894566+0000","last_active":"2024-08-31T12:21:16.971192+0000","last_peered":"2024-08-31T12:21:16.971192+0000","last_clean":"2024-08-31T12:21:16.971192+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:16.971192+0000","last_undegraded":"2024-08-31T12:21:16.971192+0000","last_fullsized":"2024-08-31T12:21:16.971192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:28.837600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"37'106","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.232778+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:21:22.232778+0000","last_peered":"2024-08-31T12:21:22.232778+0000","last_clean":"2024-08-31T12:21:22.232778+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:22.232778+0000","last_undegraded":"2024-08-31T12:21:22.232778+0000","last_fullsized":"2024-08-31T12:21:22.232778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'343","reported_seq":2483,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371775+0000","last_change":"2024-08-31T12:19:51.190295+0000","last_active":"2024-08-31T12:21:16.371775+0000","last_peered":"2024-08-31T12:21:16.371775+0000","last_clean":"2024-08-31T12:21:16.371775+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:21:16.371775+0000","last_undegraded":"2024-08-31T12:21:16.371775+0000","last_fullsized":"2024-08-31T12:21:16.371775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:44.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":8388631,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":343,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'60","reported_seq":2174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070778+0000","last_change":"2024-08-31T12:19:51.271925+0000","last_active":"2024-08-31T12:21:17.070778+0000","last_peered":"2024-08-31T12:21:17.070778+0000","last_clean":"2024-08-31T12:21:17.070778+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:17.070778+0000","last_undegraded":"2024-08-31T12:21:17.070778+0000","last_fullsized":"2024-08-31T12:21:17.070778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:14.676715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"41'18","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.373103+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:21:21.373103+0000","last_peered":"2024-08-31T12:21:21.373103+0000","last_clean":"2024-08-31T12:21:21.373103+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:21.373103+0000","last_undegraded":"2024-08-31T12:21:21.373103+0000","last_fullsized":"2024-08-31T12:21:21.373103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'359","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070204+0000","last_change":"2024-08-31T12:19:51.220620+0000","last_active":"2024-08-31T12:21:17.070204+0000","last_peered":"2024-08-31T12:21:17.070204+0000","last_clean":"2024-08-31T12:21:17.070204+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:17.070204+0000","last_undegraded":"2024-08-31T12:21:17.070204+0000","last_fullsized":"2024-08-31T12:21:17.070204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:46.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":25166248,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":4137,"num_write":357,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"42'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371907+0000","last_change":"2024-08-31T12:19:51.184941+0000","last_active":"2024-08-31T12:21:16.371907+0000","last_peered":"2024-08-31T12:21:16.371907+0000","last_clean":"2024-08-31T12:21:16.371907+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:21:16.371907+0000","last_undegraded":"2024-08-31T12:21:16.371907+0000","last_fullsized":"2024-08-31T12:21:16.371907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:58:57.275553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'298","reported_seq":409,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.865457+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:21:40.865457+0000","last_peered":"2024-08-31T12:21:40.865457+0000","last_clean":"2024-08-31T12:21:40.865457+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:40.865457+0000","last_undegraded":"2024-08-31T12:21:40.865457+0000","last_fullsized":"2024-08-31T12:21:40.865457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2502,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073988+0000","last_change":"2024-08-31T12:19:51.076234+0000","last_active":"2024-08-31T12:21:17.073988+0000","last_peered":"2024-08-31T12:21:17.073988+0000","last_clean":"2024-08-31T12:21:17.073988+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:21:17.073988+0000","last_undegraded":"2024-08-31T12:21:17.073988+0000","last_fullsized":"2024-08-31T12:21:17.073988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.257551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"52'82","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068921+0000","last_change":"2024-08-31T12:19:51.214608+0000","last_active":"2024-08-31T12:21:17.068921+0000","last_peered":"2024-08-31T12:21:17.068921+0000","last_clean":"2024-08-31T12:21:17.068921+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:17.068921+0000","last_undegraded":"2024-08-31T12:21:17.068921+0000","last_fullsized":"2024-08-31T12:21:17.068921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:32:41.739624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"42'2","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971165+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:21:16.971165+0000","last_peered":"2024-08-31T12:21:16.971165+0000","last_clean":"2024-08-31T12:21:16.971165+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:16.971165+0000","last_undegraded":"2024-08-31T12:21:16.971165+0000","last_fullsized":"2024-08-31T12:21:16.971165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'314","reported_seq":2462,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074834+0000","last_change":"2024-08-31T12:19:51.076307+0000","last_active":"2024-08-31T12:21:17.074834+0000","last_peered":"2024-08-31T12:21:17.074834+0000","last_clean":"2024-08-31T12:21:17.074834+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:21:17.074834+0000","last_undegraded":"2024-08-31T12:21:17.074834+0000","last_fullsized":"2024-08-31T12:21:17.074834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:59.114734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":16777283,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":4133,"num_write":313,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"43'86","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372280+0000","last_change":"2024-08-31T12:19:51.178571+0000","last_active":"2024-08-31T12:21:16.372280+0000","last_peered":"2024-08-31T12:21:16.372280+0000","last_clean":"2024-08-31T12:21:16.372280+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:21:16.372280+0000","last_undegraded":"2024-08-31T12:21:16.372280+0000","last_fullsized":"2024-08-31T12:21:16.372280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:51.393024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372653+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:21:16.372653+0000","last_peered":"2024-08-31T12:21:16.372653+0000","last_clean":"2024-08-31T12:21:16.372653+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:16.372653+0000","last_undegraded":"2024-08-31T12:21:16.372653+0000","last_fullsized":"2024-08-31T12:21:16.372653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'296","reported_seq":2427,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813273+0000","last_change":"2024-08-31T12:19:51.184295+0000","last_active":"2024-08-31T12:21:16.813273+0000","last_peered":"2024-08-31T12:21:16.813273+0000","last_clean":"2024-08-31T12:21:16.813273+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:21:16.813273+0000","last_undegraded":"2024-08-31T12:21:16.813273+0000","last_fullsized":"2024-08-31T12:21:16.813273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:25.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":20971556,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":294,"num_write_kb":28815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"42'76","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813884+0000","last_change":"2024-08-31T12:19:51.175019+0000","last_active":"2024-08-31T12:21:16.813884+0000","last_peered":"2024-08-31T12:21:16.813884+0000","last_clean":"2024-08-31T12:21:16.813884+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:16.813884+0000","last_undegraded":"2024-08-31T12:21:16.813884+0000","last_fullsized":"2024-08-31T12:21:16.813884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:49.573391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"55'128","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.393013+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:21:21.393013+0000","last_peered":"2024-08-31T12:21:21.393013+0000","last_clean":"2024-08-31T12:21:21.393013+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:21.393013+0000","last_undegraded":"2024-08-31T12:21:21.393013+0000","last_fullsized":"2024-08-31T12:21:21.393013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":28697,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'328","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.713623+0000","last_change":"2024-08-31T12:19:51.189127+0000","last_active":"2024-08-31T12:21:21.713623+0000","last_peered":"2024-08-31T12:21:21.713623+0000","last_clean":"2024-08-31T12:21:21.713623+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:21:21.713623+0000","last_undegraded":"2024-08-31T12:21:21.713623+0000","last_fullsized":"2024-08-31T12:21:21.713623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:53.515083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":16779999,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":327,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"55'77","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971494+0000","last_change":"2024-08-31T12:19:50.893633+0000","last_active":"2024-08-31T12:21:16.971494+0000","last_peered":"2024-08-31T12:21:16.971494+0000","last_clean":"2024-08-31T12:21:16.971494+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:21:16.971494+0000","last_undegraded":"2024-08-31T12:21:16.971494+0000","last_fullsized":"2024-08-31T12:21:16.971494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:51:49.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'170","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.766628+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:21:22.766628+0000","last_peered":"2024-08-31T12:21:22.766628+0000","last_clean":"2024-08-31T12:21:22.766628+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:22.766628+0000","last_undegraded":"2024-08-31T12:21:22.766628+0000","last_fullsized":"2024-08-31T12:21:22.766628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":40980,"num_write":164,"num_write_kb":12382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'339","reported_seq":2490,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.961472+0000","last_change":"2024-08-31T12:19:51.048401+0000","last_active":"2024-08-31T12:21:42.961472+0000","last_peered":"2024-08-31T12:21:42.961472+0000","last_clean":"2024-08-31T12:21:42.961472+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:21:42.961472+0000","last_undegraded":"2024-08-31T12:21:42.961472+0000","last_fullsized":"2024-08-31T12:21:42.961472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:17.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":336,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"43'74","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372641+0000","last_change":"2024-08-31T12:19:51.177535+0000","last_active":"2024-08-31T12:21:16.372641+0000","last_peered":"2024-08-31T12:21:16.372641+0000","last_clean":"2024-08-31T12:21:16.372641+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:21:16.372641+0000","last_undegraded":"2024-08-31T12:21:16.372641+0000","last_fullsized":"2024-08-31T12:21:16.372641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:22.493379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"55'246","reported_seq":341,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375299+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:21:21.375299+0000","last_peered":"2024-08-31T12:21:21.375299+0000","last_clean":"2024-08-31T12:21:21.375299+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:21.375299+0000","last_undegraded":"2024-08-31T12:21:21.375299+0000","last_fullsized":"2024-08-31T12:21:21.375299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":12304,"num_write":246,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'321","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069076+0000","last_change":"2024-08-31T12:19:51.266455+0000","last_active":"2024-08-31T12:21:17.069076+0000","last_peered":"2024-08-31T12:21:17.069076+0000","last_clean":"2024-08-31T12:21:17.069076+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:21:17.069076+0000","last_undegraded":"2024-08-31T12:21:17.069076+0000","last_fullsized":"2024-08-31T12:21:17.069076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:41.440357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":4194377,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":320,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"55'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.076053+0000","last_change":"2024-08-31T12:19:51.078268+0000","last_active":"2024-08-31T12:21:17.076053+0000","last_peered":"2024-08-31T12:21:17.076053+0000","last_clean":"2024-08-31T12:21:17.076053+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:17.076053+0000","last_undegraded":"2024-08-31T12:21:17.076053+0000","last_fullsized":"2024-08-31T12:21:17.076053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:07:38.413894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"55'24","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971098+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:21:16.971098+0000","last_peered":"2024-08-31T12:21:16.971098+0000","last_clean":"2024-08-31T12:21:16.971098+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:16.971098+0000","last_undegraded":"2024-08-31T12:21:16.971098+0000","last_fullsized":"2024-08-31T12:21:16.971098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'351","reported_seq":2491,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.778567+0000","last_change":"2024-08-31T12:19:50.978531+0000","last_active":"2024-08-31T12:21:26.778567+0000","last_peered":"2024-08-31T12:21:26.778567+0000","last_clean":"2024-08-31T12:21:26.778567+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:26.778567+0000","last_undegraded":"2024-08-31T12:21:26.778567+0000","last_fullsized":"2024-08-31T12:21:26.778567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:07.225950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":20971989,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":343,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"43'95","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070548+0000","last_change":"2024-08-31T12:19:51.271132+0000","last_active":"2024-08-31T12:21:17.070548+0000","last_peered":"2024-08-31T12:21:17.070548+0000","last_clean":"2024-08-31T12:21:17.070548+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:17.070548+0000","last_undegraded":"2024-08-31T12:21:17.070548+0000","last_fullsized":"2024-08-31T12:21:17.070548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:14.931872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"55'4","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071309+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:21:17.071309+0000","last_peered":"2024-08-31T12:21:17.071309+0000","last_clean":"2024-08-31T12:21:17.071309+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:17.071309+0000","last_undegraded":"2024-08-31T12:21:17.071309+0000","last_fullsized":"2024-08-31T12:21:17.071309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'336","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.901080+0000","last_change":"2024-08-31T12:19:51.051597+0000","last_active":"2024-08-31T12:21:42.901080+0000","last_peered":"2024-08-31T12:21:42.901080+0000","last_clean":"2024-08-31T12:21:42.901080+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:21:42.901080+0000","last_undegraded":"2024-08-31T12:21:42.901080+0000","last_fullsized":"2024-08-31T12:21:42.901080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:20.640303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":1440,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":336,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2458,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.919644+0000","last_change":"2024-08-31T12:19:51.050547+0000","last_active":"2024-08-31T12:21:42.919644+0000","last_peered":"2024-08-31T12:21:42.919644+0000","last_clean":"2024-08-31T12:21:42.919644+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:21:42.919644+0000","last_undegraded":"2024-08-31T12:21:42.919644+0000","last_fullsized":"2024-08-31T12:21:42.919644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:21:34.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"52'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380649+0000","last_change":"2024-08-31T12:19:51.051914+0000","last_active":"2024-08-31T12:21:16.380649+0000","last_peered":"2024-08-31T12:21:16.380649+0000","last_clean":"2024-08-31T12:21:16.380649+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:16.380649+0000","last_undegraded":"2024-08-31T12:21:16.380649+0000","last_fullsized":"2024-08-31T12:21:16.380649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:40.077019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"33'221","reported_seq":311,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.134511+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:21:22.134511+0000","last_peered":"2024-08-31T12:21:22.134511+0000","last_clean":"2024-08-31T12:21:22.134511+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:21:22.134511+0000","last_undegraded":"2024-08-31T12:21:22.134511+0000","last_fullsized":"2024-08-31T12:21:22.134511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'323","reported_seq":2465,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373191+0000","last_change":"2024-08-31T12:19:51.192804+0000","last_active":"2024-08-31T12:21:16.373191+0000","last_peered":"2024-08-31T12:21:16.373191+0000","last_clean":"2024-08-31T12:21:16.373191+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:21:16.373191+0000","last_undegraded":"2024-08-31T12:21:16.373191+0000","last_fullsized":"2024-08-31T12:21:16.373191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:57.886915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":322,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"43'101","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072765+0000","last_change":"2024-08-31T12:19:51.068760+0000","last_active":"2024-08-31T12:21:17.072765+0000","last_peered":"2024-08-31T12:21:17.072765+0000","last_clean":"2024-08-31T12:21:17.072765+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:17.072765+0000","last_undegraded":"2024-08-31T12:21:17.072765+0000","last_fullsized":"2024-08-31T12:21:17.072765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:04.217251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"42'24","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812502+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:21:16.812502+0000","last_peered":"2024-08-31T12:21:16.812502+0000","last_clean":"2024-08-31T12:21:16.812502+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:16.812502+0000","last_undegraded":"2024-08-31T12:21:16.812502+0000","last_fullsized":"2024-08-31T12:21:16.812502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"42'102","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.366771+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:21:22.366771+0000","last_peered":"2024-08-31T12:21:22.366771+0000","last_clean":"2024-08-31T12:21:22.366771+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:22.366771+0000","last_undegraded":"2024-08-31T12:21:22.366771+0000","last_fullsized":"2024-08-31T12:21:22.366771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"53'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377386+0000","last_change":"2024-08-31T12:19:51.051245+0000","last_active":"2024-08-31T12:21:16.377386+0000","last_peered":"2024-08-31T12:21:16.377386+0000","last_clean":"2024-08-31T12:21:16.377386+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:21:16.377386+0000","last_undegraded":"2024-08-31T12:21:16.377386+0000","last_fullsized":"2024-08-31T12:21:16.377386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:46:59.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'303","reported_seq":2437,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.934583+0000","last_change":"2024-08-31T12:19:51.050599+0000","last_active":"2024-08-31T12:21:42.934583+0000","last_peered":"2024-08-31T12:21:42.934583+0000","last_clean":"2024-08-31T12:21:42.934583+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:21:42.934583+0000","last_undegraded":"2024-08-31T12:21:42.934583+0000","last_fullsized":"2024-08-31T12:21:42.934583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:25:39.529445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":6071,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":302,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"42'57","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073470+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:21:17.073470+0000","last_peered":"2024-08-31T12:21:17.073470+0000","last_clean":"2024-08-31T12:21:17.073470+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:17.073470+0000","last_undegraded":"2024-08-31T12:21:17.073470+0000","last_fullsized":"2024-08-31T12:21:17.073470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070496+0000","last_change":"2024-08-31T12:19:51.221287+0000","last_active":"2024-08-31T12:21:17.070496+0000","last_peered":"2024-08-31T12:21:17.070496+0000","last_clean":"2024-08-31T12:21:17.070496+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:17.070496+0000","last_undegraded":"2024-08-31T12:21:17.070496+0000","last_fullsized":"2024-08-31T12:21:17.070496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:26.700201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'319","reported_seq":2471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:20.767973+0000","last_change":"2024-08-31T12:19:50.983158+0000","last_active":"2024-08-31T12:21:20.767973+0000","last_peered":"2024-08-31T12:21:20.767973+0000","last_clean":"2024-08-31T12:21:20.767973+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:21:20.767973+0000","last_undegraded":"2024-08-31T12:21:20.767973+0000","last_fullsized":"2024-08-31T12:21:20.767973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.643813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":8388700,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":8234,"num_write":317,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"53'99","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068480+0000","last_change":"2024-08-31T12:19:51.269244+0000","last_active":"2024-08-31T12:21:17.068480+0000","last_peered":"2024-08-31T12:21:17.068480+0000","last_clean":"2024-08-31T12:21:17.068480+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:17.068480+0000","last_undegraded":"2024-08-31T12:21:17.068480+0000","last_fullsized":"2024-08-31T12:21:17.068480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:56.132161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377445+0000","last_change":"2024-08-31T12:19:50.981299+0000","last_active":"2024-08-31T12:21:16.377445+0000","last_peered":"2024-08-31T12:21:16.377445+0000","last_clean":"2024-08-31T12:21:16.377445+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:16.377445+0000","last_undegraded":"2024-08-31T12:21:16.377445+0000","last_fullsized":"2024-08-31T12:21:16.377445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:35.055501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"42'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371976+0000","last_change":"2024-08-31T12:19:51.186593+0000","last_active":"2024-08-31T12:21:16.371976+0000","last_peered":"2024-08-31T12:21:16.371976+0000","last_clean":"2024-08-31T12:21:16.371976+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:21:16.371976+0000","last_undegraded":"2024-08-31T12:21:16.371976+0000","last_fullsized":"2024-08-31T12:21:16.371976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:04.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"43'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071803+0000","last_change":"2024-08-31T12:19:51.074951+0000","last_active":"2024-08-31T12:21:17.071803+0000","last_peered":"2024-08-31T12:21:17.071803+0000","last_clean":"2024-08-31T12:21:17.071803+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:17.071803+0000","last_undegraded":"2024-08-31T12:21:17.071803+0000","last_fullsized":"2024-08-31T12:21:17.071803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:59:00.684606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815095+0000","last_change":"2024-08-31T12:19:51.185342+0000","last_active":"2024-08-31T12:21:16.815095+0000","last_peered":"2024-08-31T12:21:16.815095+0000","last_clean":"2024-08-31T12:21:16.815095+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:16.815095+0000","last_undegraded":"2024-08-31T12:21:16.815095+0000","last_fullsized":"2024-08-31T12:21:16.815095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:43.897575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"55'68","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813330+0000","last_change":"2024-08-31T12:19:51.181704+0000","last_active":"2024-08-31T12:21:16.813330+0000","last_peered":"2024-08-31T12:21:16.813330+0000","last_clean":"2024-08-31T12:21:16.813330+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:16.813330+0000","last_undegraded":"2024-08-31T12:21:16.813330+0000","last_fullsized":"2024-08-31T12:21:16.813330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.178489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"43'94","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070274+0000","last_change":"2024-08-31T12:19:51.271453+0000","last_active":"2024-08-31T12:21:17.070274+0000","last_peered":"2024-08-31T12:21:17.070274+0000","last_clean":"2024-08-31T12:21:17.070274+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:17.070274+0000","last_undegraded":"2024-08-31T12:21:17.070274+0000","last_fullsized":"2024-08-31T12:21:17.070274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:08:45.605808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"43'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074459+0000","last_change":"2024-08-31T12:19:51.078039+0000","last_active":"2024-08-31T12:21:17.074459+0000","last_peered":"2024-08-31T12:21:17.074459+0000","last_clean":"2024-08-31T12:21:17.074459+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:21:17.074459+0000","last_undegraded":"2024-08-31T12:21:17.074459+0000","last_fullsized":"2024-08-31T12:21:17.074459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:29.368356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"55'86","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372412+0000","last_change":"2024-08-31T12:19:51.186883+0000","last_active":"2024-08-31T12:21:16.372412+0000","last_peered":"2024-08-31T12:21:16.372412+0000","last_clean":"2024-08-31T12:21:16.372412+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:21:16.372412+0000","last_undegraded":"2024-08-31T12:21:16.372412+0000","last_fullsized":"2024-08-31T12:21:16.372412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:08.504264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"42'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071591+0000","last_change":"2024-08-31T12:19:51.064708+0000","last_active":"2024-08-31T12:21:17.071591+0000","last_peered":"2024-08-31T12:21:17.071591+0000","last_clean":"2024-08-31T12:21:17.071591+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:21:17.071591+0000","last_undegraded":"2024-08-31T12:21:17.071591+0000","last_fullsized":"2024-08-31T12:21:17.071591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:09.085855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"55'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070101+0000","last_change":"2024-08-31T12:19:51.223300+0000","last_active":"2024-08-31T12:21:17.070101+0000","last_peered":"2024-08-31T12:21:17.070101+0000","last_clean":"2024-08-31T12:21:17.070101+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:17.070101+0000","last_undegraded":"2024-08-31T12:21:17.070101+0000","last_fullsized":"2024-08-31T12:21:17.070101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:32:18.034547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"55'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:51.048787+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:11:02.319788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"43'89","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971033+0000","last_change":"2024-08-31T12:19:50.893976+0000","last_active":"2024-08-31T12:21:16.971033+0000","last_peered":"2024-08-31T12:21:16.971033+0000","last_clean":"2024-08-31T12:21:16.971033+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:21:16.971033+0000","last_undegraded":"2024-08-31T12:21:16.971033+0000","last_fullsized":"2024-08-31T12:21:16.971033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:31.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373594+0000","last_change":"2024-08-31T12:19:51.192143+0000","last_active":"2024-08-31T12:21:16.373594+0000","last_peered":"2024-08-31T12:21:16.373594+0000","last_clean":"2024-08-31T12:21:16.373594+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:21:16.373594+0000","last_undegraded":"2024-08-31T12:21:16.373594+0000","last_fullsized":"2024-08-31T12:21:16.373594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:03:48.542655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"52'79","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380351+0000","last_change":"2024-08-31T12:19:50.982520+0000","last_active":"2024-08-31T12:21:16.380351+0000","last_peered":"2024-08-31T12:21:16.380351+0000","last_clean":"2024-08-31T12:21:16.380351+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:16.380351+0000","last_undegraded":"2024-08-31T12:21:16.380351+0000","last_fullsized":"2024-08-31T12:21:16.380351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:34.588788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"55'87","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373374+0000","last_change":"2024-08-31T12:19:51.192768+0000","last_active":"2024-08-31T12:21:16.373374+0000","last_peered":"2024-08-31T12:21:16.373374+0000","last_clean":"2024-08-31T12:21:16.373374+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:21:16.373374+0000","last_undegraded":"2024-08-31T12:21:16.373374+0000","last_fullsized":"2024-08-31T12:21:16.373374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:39.267549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"55'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371884+0000","last_change":"2024-08-31T12:19:51.185985+0000","last_active":"2024-08-31T12:21:16.371884+0000","last_peered":"2024-08-31T12:21:16.371884+0000","last_clean":"2024-08-31T12:21:16.371884+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:21:16.371884+0000","last_undegraded":"2024-08-31T12:21:16.371884+0000","last_fullsized":"2024-08-31T12:21:16.371884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:21.405555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"43'78","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071149+0000","last_change":"2024-08-31T12:19:51.063460+0000","last_active":"2024-08-31T12:21:17.071149+0000","last_peered":"2024-08-31T12:21:17.071149+0000","last_clean":"2024-08-31T12:21:17.071149+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:21:17.071149+0000","last_undegraded":"2024-08-31T12:21:17.071149+0000","last_fullsized":"2024-08-31T12:21:17.071149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:33.292394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"43'85","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812455+0000","last_change":"2024-08-31T12:19:51.174772+0000","last_active":"2024-08-31T12:21:16.812455+0000","last_peered":"2024-08-31T12:21:16.812455+0000","last_clean":"2024-08-31T12:21:16.812455+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:21:16.812455+0000","last_undegraded":"2024-08-31T12:21:16.812455+0000","last_fullsized":"2024-08-31T12:21:16.812455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:54:29.129773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"44'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812860+0000","last_change":"2024-08-31T12:19:51.181127+0000","last_active":"2024-08-31T12:21:16.812860+0000","last_peered":"2024-08-31T12:21:16.812860+0000","last_clean":"2024-08-31T12:21:16.812860+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:21:16.812860+0000","last_undegraded":"2024-08-31T12:21:16.812860+0000","last_fullsized":"2024-08-31T12:21:16.812860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.484043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"45'69","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970992+0000","last_change":"2024-08-31T12:19:50.892823+0000","last_active":"2024-08-31T12:21:16.970992+0000","last_peered":"2024-08-31T12:21:16.970992+0000","last_clean":"2024-08-31T12:21:16.970992+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:21:16.970992+0000","last_undegraded":"2024-08-31T12:21:16.970992+0000","last_fullsized":"2024-08-31T12:21:16.970992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:37.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"43'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971068+0000","last_change":"2024-08-31T12:19:50.893929+0000","last_active":"2024-08-31T12:21:16.971068+0000","last_peered":"2024-08-31T12:21:16.971068+0000","last_clean":"2024-08-31T12:21:16.971068+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:21:16.971068+0000","last_undegraded":"2024-08-31T12:21:16.971068+0000","last_fullsized":"2024-08-31T12:21:16.971068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:33.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970963+0000","last_change":"2024-08-31T12:19:50.894286+0000","last_active":"2024-08-31T12:21:16.970963+0000","last_peered":"2024-08-31T12:21:16.970963+0000","last_clean":"2024-08-31T12:21:16.970963+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:16.970963+0000","last_undegraded":"2024-08-31T12:21:16.970963+0000","last_fullsized":"2024-08-31T12:21:16.970963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:11.536744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071275+0000","last_change":"2024-08-31T12:19:51.225674+0000","last_active":"2024-08-31T12:21:17.071275+0000","last_peered":"2024-08-31T12:21:17.071275+0000","last_clean":"2024-08-31T12:21:17.071275+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:17.071275+0000","last_undegraded":"2024-08-31T12:21:17.071275+0000","last_fullsized":"2024-08-31T12:21:17.071275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:58.545098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"47'65","reported_seq":2179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071120+0000","last_change":"2024-08-31T12:19:51.040117+0000","last_active":"2024-08-31T12:21:17.071120+0000","last_peered":"2024-08-31T12:21:17.071120+0000","last_clean":"2024-08-31T12:21:17.071120+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:17.071120+0000","last_undegraded":"2024-08-31T12:21:17.071120+0000","last_fullsized":"2024-08-31T12:21:17.071120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:02.594079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"55'100","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970362+0000","last_change":"2024-08-31T12:19:50.892284+0000","last_active":"2024-08-31T12:21:16.970362+0000","last_peered":"2024-08-31T12:21:16.970362+0000","last_clean":"2024-08-31T12:21:16.970362+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:16.970362+0000","last_undegraded":"2024-08-31T12:21:16.970362+0000","last_fullsized":"2024-08-31T12:21:16.970362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:08:03.924404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"42'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069723+0000","last_change":"2024-08-31T12:19:51.267262+0000","last_active":"2024-08-31T12:21:17.069723+0000","last_peered":"2024-08-31T12:21:17.069723+0000","last_clean":"2024-08-31T12:21:17.069723+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:17.069723+0000","last_undegraded":"2024-08-31T12:21:17.069723+0000","last_fullsized":"2024-08-31T12:21:17.069723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:43.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970549+0000","last_change":"2024-08-31T12:19:50.893034+0000","last_active":"2024-08-31T12:21:16.970549+0000","last_peered":"2024-08-31T12:21:16.970549+0000","last_clean":"2024-08-31T12:21:16.970549+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:16.970549+0000","last_undegraded":"2024-08-31T12:21:16.970549+0000","last_fullsized":"2024-08-31T12:21:16.970549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:43.248554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"52'67","reported_seq":2181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069464+0000","last_change":"2024-08-31T12:19:51.264462+0000","last_active":"2024-08-31T12:21:17.069464+0000","last_peered":"2024-08-31T12:21:17.069464+0000","last_clean":"2024-08-31T12:21:17.069464+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:17.069464+0000","last_undegraded":"2024-08-31T12:21:17.069464+0000","last_fullsized":"2024-08-31T12:21:17.069464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:42.905157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"45'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072984+0000","last_change":"2024-08-31T12:19:51.075411+0000","last_active":"2024-08-31T12:21:17.072984+0000","last_peered":"2024-08-31T12:21:17.072984+0000","last_clean":"2024-08-31T12:21:17.072984+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:21:17.072984+0000","last_undegraded":"2024-08-31T12:21:17.072984+0000","last_fullsized":"2024-08-31T12:21:17.072984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:36.650512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"55'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073271+0000","last_change":"2024-08-31T12:19:51.075045+0000","last_active":"2024-08-31T12:21:17.073271+0000","last_peered":"2024-08-31T12:21:17.073271+0000","last_clean":"2024-08-31T12:21:17.073271+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:21:17.073271+0000","last_undegraded":"2024-08-31T12:21:17.073271+0000","last_fullsized":"2024-08-31T12:21:17.073271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:45.340712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970900+0000","last_change":"2024-08-31T12:19:50.894206+0000","last_active":"2024-08-31T12:21:16.970900+0000","last_peered":"2024-08-31T12:21:16.970900+0000","last_clean":"2024-08-31T12:21:16.970900+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:21:16.970900+0000","last_undegraded":"2024-08-31T12:21:16.970900+0000","last_fullsized":"2024-08-31T12:21:16.970900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:36:32.545870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":348156025,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":1140,"num_read_kb":65823,"num_write":10676,"num_write_kb":540068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":719446016,"data_stored":719446016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10729,"ondisk_log_size":10729,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5266,"ondisk_log_size":5266,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144490859,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":468,"num_read_kb":466026,"num_write":4533,"num_write_kb":144462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":288231424,"data_stored":288166153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4365,"ondisk_log_size":4365,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246080,"kb_used_data":134384,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94125760,"statfs":{"total":96636764160,"available":96384778240,"internally_reserved":0,"allocated":137609216,"data_stored":137294400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221172,"kb_used_data":135844,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94150668,"statfs":{"total":96636764160,"available":96410284032,"internally_reserved":0,"allocated":139104256,"data_stored":138799761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207900,"kb_used_data":122572,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94163940,"statfs":{"total":96636764160,"available":96423874560,"internally_reserved":0,"allocated":125513728,"data_stored":125195328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241528,"kb_used_data":160360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94130312,"statfs":{"total":96636764160,"available":96389439488,"internally_reserved":0,"allocated":164208640,"data_stored":163900631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83098055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201140,"kb_used_data":129700,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94170700,"statfs":{"total":96636764160,"available":96430796800,"internally_reserved":0,"allocated":132812800,"data_stored":132500785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244472,"kb_used_data":146664,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94127368,"statfs":{"total":96636764160,"available":96386424832,"internally_reserved":0,"allocated":150183936,"data_stored":149871863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197516,"kb_used_data":121916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94174324,"statfs":{"total":96636764160,"available":96434507776,"internally_reserved":0,"allocated":124841984,"data_stored":124525942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128324,"kb_used_data":38836,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243516,"statfs":{"total":96636764160,"available":96505360384,"internally_reserved":0,"allocated":39768064,"data_stored":39445579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55029760,"data_stored":55018213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39075840,"data_stored":39057850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34140160,"data_stored":34129807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25751552,"data_stored":25741231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69165056,"data_stored":69165056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115384320,"data_stored":115384320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106991616,"data_stored":106991616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109031424,"data_stored":109031424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":45056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90132480,"data_stored":90132480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":117485568,"data_stored":117485568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":111210496,"data_stored":111210496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:21:45.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:21:45.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- 172.21.15.164:0/1252905108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c1f40 msgr2=0x7ff28c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 --2- 172.21.15.164:0/1252905108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c1f40 0x7ff28c152a10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff28c073280 tx=0x7ff27401f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- 172.21.15.164:0/1252905108 shutdown_connections 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 --2- 172.21.15.164:0/1252905108 >> v2:172.21.15.184:3300/0 conn(0x7ff28c0c9330 0x7ff28c074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 --2- 172.21.15.164:0/1252905108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c1f40 0x7ff28c152a10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- 172.21.15.164:0/1252905108 >> 172.21.15.164:0/1252905108 conn(0x7ff28c0ccf20 msgr2=0x7ff28c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- 172.21.15.164:0/1252905108 shutdown_connections 2024-08-31T12:21:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- 172.21.15.164:0/1252905108 wait complete. 2024-08-31T12:21:45.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 Processor -- start 2024-08-31T12:21:45.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.923+0000 7ff292600640 1 -- start start 2024-08-31T12:21:45.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 0x7ff28c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff28c15bc70 0x7ff28c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c0c8030 con 0x7ff28c0c9330 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c0c3150 con 0x7ff28c0c1f40 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff28c074c60 con 0x7ff28c15bc70 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47322/0 (socket says 172.21.15.164:47322) 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 -- 172.21.15.164:0/3314269360 learned_addr learned my addr 172.21.15.164:0/3314269360 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:45.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff28b400640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 0x7ff28c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff28be00640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff28c15bc70 0x7ff28c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 -- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff28c15bc70 msgr2=0x7ff28c1f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff28c15bc70 0x7ff28c1f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 -- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 msgr2=0x7ff28c154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 0x7ff28c154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 -- 172.21.15.164:0/3314269360 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c1515b0 con 0x7ff28c0c9330 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff28b400640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 0x7ff28c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:45.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff282a00640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff27401d760 tx=0x7ff274005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b5040 con 0x7ff28c0c9330 2024-08-31T12:21:45.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff274005320 con 0x7ff28c0c9330 2024-08-31T12:21:45.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28c0c6b20 con 0x7ff28c0c9330 2024-08-31T12:21:45.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740046d0 con 0x7ff28c0c9330 2024-08-31T12:21:45.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28c0c70e0 con 0x7ff28c0c9330 2024-08-31T12:21:45.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.927+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28c152a10 con 0x7ff28c0c9330 2024-08-31T12:21:45.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff2740c1060 con 0x7ff28c0c9330 2024-08-31T12:21:45.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff283e00640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 0x7ff2680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7ff27412fd80 con 0x7ff28c0c9330 2024-08-31T12:21:45.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff28b400640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 0x7ff2680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff28b400640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 0x7ff2680745d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0098b0 tx=0x7ff27c008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:45.931+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff274018c10 con 0x7ff28c0c9330 2024-08-31T12:21:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.095+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff28c1560a0 con 0x7ff2680720c0 2024-08-31T12:21:46.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff283e00640 1 -- 172.21.15.164:0/3314269360 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336098 (secure 0 0 0) 0x7ff28c1560a0 con 0x7ff2680720c0 2024-08-31T12:21:46.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:46.120 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:21:46.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 msgr2=0x7ff2680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 0x7ff2680745d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0098b0 tx=0x7ff27c008040 comp rx=0 tx=0).stop 2024-08-31T12:21:46.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 msgr2=0x7ff28c1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff27401d760 tx=0x7ff274005780 comp rx=0 tx=0).stop 2024-08-31T12:21:46.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 shutdown_connections 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2680720c0 0x7ff2680745d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff28c15bc70 0x7ff28c1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c0c9330 0x7ff28c1554e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 --2- 172.21.15.164:0/3314269360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c0c1f40 0x7ff28c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 >> 172.21.15.164:0/3314269360 conn(0x7ff28c0ccf20 msgr2=0x7ff28c074090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 shutdown_connections 2024-08-31T12:21:46.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.115+0000 7ff292600640 1 -- 172.21.15.164:0/3314269360 wait complete. 2024-08-31T12:21:46.140 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-08-31T12:21:44.755442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":493237252,"num_objects":166,"num_object_clones":0,"num_object_copies":544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":1674,"num_read_kb":531904,"num_write":15310,"num_write_kb":686158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20432,"ondisk_log_size":20432,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1688132,"kb_used_data":990276,"kb_used_omap":12,"kb_used_meta":697715,"kb_avail":753286588,"statfs":{"total":773094113280,"available":771365466112,"internally_reserved":0,"allocated":1014042624,"data_stored":1011534289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":714460721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-66121297,"num_objects":-17,"num_object_clones":0,"num_object_copies":-68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":78,"num_write_kb":828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006353"},"pg_stats":[{"pgid":"2.1f","version":"56'59","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.855289+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:21:23.855289+0000","last_peered":"2024-08-31T12:21:23.855289+0000","last_clean":"2024-08-31T12:21:23.855289+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:23.855289+0000","last_undegraded":"2024-08-31T12:21:23.855289+0000","last_fullsized":"2024-08-31T12:21:23.855289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"43'87","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074630+0000","last_change":"2024-08-31T12:19:51.077673+0000","last_active":"2024-08-31T12:21:17.074630+0000","last_peered":"2024-08-31T12:21:17.074630+0000","last_clean":"2024-08-31T12:21:17.074630+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:17.074630+0000","last_undegraded":"2024-08-31T12:21:17.074630+0000","last_fullsized":"2024-08-31T12:21:17.074630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:27.050879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"55'363","reported_seq":2506,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:50.981608+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:24:47.867907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":360,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"55'81","reported_seq":171,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074838+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:21:17.074838+0000","last_peered":"2024-08-31T12:21:17.074838+0000","last_clean":"2024-08-31T12:21:17.074838+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:21:17.074838+0000","last_undegraded":"2024-08-31T12:21:17.074838+0000","last_fullsized":"2024-08-31T12:21:17.074838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"47'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.075830+0000","last_change":"2024-08-31T12:19:51.078041+0000","last_active":"2024-08-31T12:21:17.075830+0000","last_peered":"2024-08-31T12:21:17.075830+0000","last_clean":"2024-08-31T12:21:17.075830+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:21:17.075830+0000","last_undegraded":"2024-08-31T12:21:17.075830+0000","last_fullsized":"2024-08-31T12:21:17.075830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:40.429055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'344","reported_seq":2486,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068332+0000","last_change":"2024-08-31T12:19:51.270521+0000","last_active":"2024-08-31T12:21:17.068332+0000","last_peered":"2024-08-31T12:21:17.068332+0000","last_clean":"2024-08-31T12:21:17.068332+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:21:17.068332+0000","last_undegraded":"2024-08-31T12:21:17.068332+0000","last_fullsized":"2024-08-31T12:21:17.068332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:42:30.397283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":343,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1937","reported_seq":2035,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.403350+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:21:21.403350+0000","last_peered":"2024-08-31T12:21:21.403350+0000","last_clean":"2024-08-31T12:21:21.403350+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:21:21.403350+0000","last_undegraded":"2024-08-31T12:21:21.403350+0000","last_fullsized":"2024-08-31T12:21:21.403350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":38900,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"53'81","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070461+0000","last_change":"2024-08-31T12:19:51.222939+0000","last_active":"2024-08-31T12:21:17.070461+0000","last_peered":"2024-08-31T12:21:17.070461+0000","last_clean":"2024-08-31T12:21:17.070461+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:17.070461+0000","last_undegraded":"2024-08-31T12:21:17.070461+0000","last_fullsized":"2024-08-31T12:21:17.070461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:45.439283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"55'365","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.265557+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:34.207533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":364,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"55'49","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971951+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:21:16.971951+0000","last_peered":"2024-08-31T12:21:16.971951+0000","last_clean":"2024-08-31T12:21:16.971951+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:16.971951+0000","last_undegraded":"2024-08-31T12:21:16.971951+0000","last_fullsized":"2024-08-31T12:21:16.971951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372884+0000","last_change":"2024-08-31T12:19:51.191343+0000","last_active":"2024-08-31T12:21:16.372884+0000","last_peered":"2024-08-31T12:21:16.372884+0000","last_clean":"2024-08-31T12:21:16.372884+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:21:16.372884+0000","last_undegraded":"2024-08-31T12:21:16.372884+0000","last_fullsized":"2024-08-31T12:21:16.372884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:55.638854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"55'331","reported_seq":2474,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068734+0000","last_change":"2024-08-31T12:19:51.266908+0000","last_active":"2024-08-31T12:21:17.068734+0000","last_peered":"2024-08-31T12:21:17.068734+0000","last_clean":"2024-08-31T12:21:17.068734+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:21:17.068734+0000","last_undegraded":"2024-08-31T12:21:17.068734+0000","last_fullsized":"2024-08-31T12:21:17.068734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:53.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":331,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372070+0000","last_change":"2024-08-31T12:19:51.182717+0000","last_active":"2024-08-31T12:21:16.372070+0000","last_peered":"2024-08-31T12:21:16.372070+0000","last_clean":"2024-08-31T12:21:16.372070+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:16.372070+0000","last_undegraded":"2024-08-31T12:21:16.372070+0000","last_fullsized":"2024-08-31T12:21:16.372070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:02:01.902388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"55'85","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.385266+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:21:21.385266+0000","last_peered":"2024-08-31T12:21:21.385266+0000","last_clean":"2024-08-31T12:21:21.385266+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:21.385266+0000","last_undegraded":"2024-08-31T12:21:21.385266+0000","last_fullsized":"2024-08-31T12:21:21.385266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'335","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970562+0000","last_change":"2024-08-31T12:19:50.893218+0000","last_active":"2024-08-31T12:21:16.970562+0000","last_peered":"2024-08-31T12:21:16.970562+0000","last_clean":"2024-08-31T12:21:16.970562+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:21:16.970562+0000","last_undegraded":"2024-08-31T12:21:16.970562+0000","last_fullsized":"2024-08-31T12:21:16.970562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:26.717821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":334,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'80","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.379462+0000","last_change":"2024-08-31T12:19:50.981970+0000","last_active":"2024-08-31T12:21:16.379462+0000","last_peered":"2024-08-31T12:21:16.379462+0000","last_clean":"2024-08-31T12:21:16.379462+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:16.379462+0000","last_undegraded":"2024-08-31T12:21:16.379462+0000","last_fullsized":"2024-08-31T12:21:16.379462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:50:55.324238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"42'23","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815017+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:21:16.815017+0000","last_peered":"2024-08-31T12:21:16.815017+0000","last_clean":"2024-08-31T12:21:16.815017+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:16.815017+0000","last_undegraded":"2024-08-31T12:21:16.815017+0000","last_fullsized":"2024-08-31T12:21:16.815017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"55'362","reported_seq":2505,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970380+0000","last_change":"2024-08-31T12:19:50.893757+0000","last_active":"2024-08-31T12:21:16.970380+0000","last_peered":"2024-08-31T12:21:16.970380+0000","last_clean":"2024-08-31T12:21:16.970380+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:21:16.970380+0000","last_undegraded":"2024-08-31T12:21:16.970380+0000","last_fullsized":"2024-08-31T12:21:16.970380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:38:01.625027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":359,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373448+0000","last_change":"2024-08-31T12:19:51.043981+0000","last_active":"2024-08-31T12:21:16.373448+0000","last_peered":"2024-08-31T12:21:16.373448+0000","last_clean":"2024-08-31T12:21:16.373448+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:21:16.373448+0000","last_undegraded":"2024-08-31T12:21:16.373448+0000","last_fullsized":"2024-08-31T12:21:16.373448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:13.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'86","reported_seq":172,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.779627+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:21:42.779627+0000","last_peered":"2024-08-31T12:21:42.779627+0000","last_clean":"2024-08-31T12:21:42.779627+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:21:42.779627+0000","last_undegraded":"2024-08-31T12:21:42.779627+0000","last_fullsized":"2024-08-31T12:21:42.779627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307770,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":82,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'335","reported_seq":2485,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380280+0000","last_change":"2024-08-31T12:19:50.982738+0000","last_active":"2024-08-31T12:21:16.380280+0000","last_peered":"2024-08-31T12:21:16.380280+0000","last_clean":"2024-08-31T12:21:16.380280+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:16.380280+0000","last_undegraded":"2024-08-31T12:21:16.380280+0000","last_fullsized":"2024-08-31T12:21:16.380280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:27:32.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":8232,"num_write":331,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"53'92","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371986+0000","last_change":"2024-08-31T12:19:51.179971+0000","last_active":"2024-08-31T12:21:16.371986+0000","last_peered":"2024-08-31T12:21:16.371986+0000","last_clean":"2024-08-31T12:21:16.371986+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:16.371986+0000","last_undegraded":"2024-08-31T12:21:16.371986+0000","last_fullsized":"2024-08-31T12:21:16.371986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:49:48.420577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'8","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970212+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:21:16.970212+0000","last_peered":"2024-08-31T12:21:16.970212+0000","last_clean":"2024-08-31T12:21:16.970212+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:16.970212+0000","last_undegraded":"2024-08-31T12:21:16.970212+0000","last_fullsized":"2024-08-31T12:21:16.970212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"55'281","reported_seq":2426,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069212+0000","last_change":"2024-08-31T12:19:51.271430+0000","last_active":"2024-08-31T12:21:17.069212+0000","last_peered":"2024-08-31T12:21:17.069212+0000","last_clean":"2024-08-31T12:21:17.069212+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:17.069212+0000","last_undegraded":"2024-08-31T12:21:17.069212+0000","last_fullsized":"2024-08-31T12:21:17.069212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:12.164256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":279,"num_write_kb":16521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.383778+0000","last_change":"2024-08-31T12:19:51.049750+0000","last_active":"2024-08-31T12:21:16.383778+0000","last_peered":"2024-08-31T12:21:16.383778+0000","last_clean":"2024-08-31T12:21:16.383778+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:16.383778+0000","last_undegraded":"2024-08-31T12:21:16.383778+0000","last_fullsized":"2024-08-31T12:21:16.383778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:52.154694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'8","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.852975+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:21:23.852975+0000","last_peered":"2024-08-31T12:21:23.852975+0000","last_clean":"2024-08-31T12:21:23.852975+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:23.852975+0000","last_undegraded":"2024-08-31T12:21:23.852975+0000","last_fullsized":"2024-08-31T12:21:23.852975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'356","reported_seq":2492,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068333+0000","last_change":"2024-08-31T12:19:51.267348+0000","last_active":"2024-08-31T12:21:17.068333+0000","last_peered":"2024-08-31T12:21:17.068333+0000","last_clean":"2024-08-31T12:21:17.068333+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:17.068333+0000","last_undegraded":"2024-08-31T12:21:17.068333+0000","last_fullsized":"2024-08-31T12:21:17.068333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:52:51.279879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":20972894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":354,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"55'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.382991+0000","last_change":"2024-08-31T12:19:51.047806+0000","last_active":"2024-08-31T12:21:16.382991+0000","last_peered":"2024-08-31T12:21:16.382991+0000","last_clean":"2024-08-31T12:21:16.382991+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:16.382991+0000","last_undegraded":"2024-08-31T12:21:16.382991+0000","last_fullsized":"2024-08-31T12:21:16.382991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:27:44.404451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'168","reported_seq":258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.852923+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:21:41.852923+0000","last_peered":"2024-08-31T12:21:41.852923+0000","last_clean":"2024-08-31T12:21:41.852923+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:41.852923+0000","last_undegraded":"2024-08-31T12:21:41.852923+0000","last_fullsized":"2024-08-31T12:21:41.852923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":409,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'357","reported_seq":2514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.920444+0000","last_change":"2024-08-31T12:19:51.044689+0000","last_active":"2024-08-31T12:21:42.920444+0000","last_peered":"2024-08-31T12:21:42.920444+0000","last_clean":"2024-08-31T12:21:42.920444+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:21:42.920444+0000","last_undegraded":"2024-08-31T12:21:42.920444+0000","last_fullsized":"2024-08-31T12:21:42.920444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:00:11.862454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":1492,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":355,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"43'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815142+0000","last_change":"2024-08-31T12:19:51.184067+0000","last_active":"2024-08-31T12:21:16.815142+0000","last_peered":"2024-08-31T12:21:16.815142+0000","last_clean":"2024-08-31T12:21:16.815142+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:16.815142+0000","last_undegraded":"2024-08-31T12:21:16.815142+0000","last_fullsized":"2024-08-31T12:21:16.815142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:03.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"42'21","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373694+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:21:16.373694+0000","last_peered":"2024-08-31T12:21:16.373694+0000","last_clean":"2024-08-31T12:21:16.373694+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:16.373694+0000","last_undegraded":"2024-08-31T12:21:16.373694+0000","last_fullsized":"2024-08-31T12:21:16.373694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'367","reported_seq":2507,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.787456+0000","last_change":"2024-08-31T12:19:51.178915+0000","last_active":"2024-08-31T12:21:26.787456+0000","last_peered":"2024-08-31T12:21:26.787456+0000","last_clean":"2024-08-31T12:21:26.787456+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:21:26.787456+0000","last_undegraded":"2024-08-31T12:21:26.787456+0000","last_fullsized":"2024-08-31T12:21:26.787456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:55.684998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":20971859,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":367,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"43'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.267618+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:57.623085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072705+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:21:17.072705+0000","last_peered":"2024-08-31T12:21:17.072705+0000","last_clean":"2024-08-31T12:21:17.072705+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:17.072705+0000","last_undegraded":"2024-08-31T12:21:17.072705+0000","last_fullsized":"2024-08-31T12:21:17.072705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'351","reported_seq":2493,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812483+0000","last_change":"2024-08-31T12:19:51.175945+0000","last_active":"2024-08-31T12:21:16.812483+0000","last_peered":"2024-08-31T12:21:16.812483+0000","last_clean":"2024-08-31T12:21:16.812483+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:21:16.812483+0000","last_undegraded":"2024-08-31T12:21:16.812483+0000","last_fullsized":"2024-08-31T12:21:16.812483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:03:44.835939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":4199202,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":350,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"53'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970407+0000","last_change":"2024-08-31T12:19:50.892454+0000","last_active":"2024-08-31T12:21:16.970407+0000","last_peered":"2024-08-31T12:21:16.970407+0000","last_clean":"2024-08-31T12:21:16.970407+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:16.970407+0000","last_undegraded":"2024-08-31T12:21:16.970407+0000","last_fullsized":"2024-08-31T12:21:16.970407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:35:26.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'167","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.582813+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:21:21.582813+0000","last_peered":"2024-08-31T12:21:21.582813+0000","last_clean":"2024-08-31T12:21:21.582813+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:21.582813+0000","last_undegraded":"2024-08-31T12:21:21.582813+0000","last_fullsized":"2024-08-31T12:21:21.582813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'317","reported_seq":2452,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814080+0000","last_change":"2024-08-31T12:19:51.183892+0000","last_active":"2024-08-31T12:21:16.814080+0000","last_peered":"2024-08-31T12:21:16.814080+0000","last_clean":"2024-08-31T12:21:16.814080+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:21:16.814080+0000","last_undegraded":"2024-08-31T12:21:16.814080+0000","last_fullsized":"2024-08-31T12:21:16.814080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:30.314422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":8393263,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3300,"num_write":317,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071145+0000","last_change":"2024-08-31T12:19:51.049351+0000","last_active":"2024-08-31T12:21:17.071145+0000","last_peered":"2024-08-31T12:21:17.071145+0000","last_clean":"2024-08-31T12:21:17.071145+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:17.071145+0000","last_undegraded":"2024-08-31T12:21:17.071145+0000","last_fullsized":"2024-08-31T12:21:17.071145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:40.766633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"55'141","reported_seq":366,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.378461+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:21:16.378461+0000","last_peered":"2024-08-31T12:21:16.378461+0000","last_clean":"2024-08-31T12:21:16.378461+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:16.378461+0000","last_undegraded":"2024-08-31T12:21:16.378461+0000","last_fullsized":"2024-08-31T12:21:16.378461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575283,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":654,"num_write":137,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"55'330","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814058+0000","last_change":"2024-08-31T12:19:51.184441+0000","last_active":"2024-08-31T12:21:16.814058+0000","last_peered":"2024-08-31T12:21:16.814058+0000","last_clean":"2024-08-31T12:21:16.814058+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:21:16.814058+0000","last_undegraded":"2024-08-31T12:21:16.814058+0000","last_fullsized":"2024-08-31T12:21:16.814058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:55:53.475438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":329,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"52'77","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812314+0000","last_change":"2024-08-31T12:19:51.182725+0000","last_active":"2024-08-31T12:21:16.812314+0000","last_peered":"2024-08-31T12:21:16.812314+0000","last_clean":"2024-08-31T12:21:16.812314+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:16.812314+0000","last_undegraded":"2024-08-31T12:21:16.812314+0000","last_fullsized":"2024-08-31T12:21:16.812314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:17:40.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'101","reported_seq":192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.798818+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:21:21.798818+0000","last_peered":"2024-08-31T12:21:21.798818+0000","last_clean":"2024-08-31T12:21:21.798818+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:21:21.798818+0000","last_undegraded":"2024-08-31T12:21:21.798818+0000","last_fullsized":"2024-08-31T12:21:21.798818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072317+0000","last_change":"2024-08-31T12:19:51.075766+0000","last_active":"2024-08-31T12:21:17.072317+0000","last_peered":"2024-08-31T12:21:17.072317+0000","last_clean":"2024-08-31T12:21:17.072317+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:21:17.072317+0000","last_undegraded":"2024-08-31T12:21:17.072317+0000","last_fullsized":"2024-08-31T12:21:17.072317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:27.063933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"55'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375625+0000","last_change":"2024-08-31T12:19:51.049809+0000","last_active":"2024-08-31T12:21:16.375625+0000","last_peered":"2024-08-31T12:21:16.375625+0000","last_clean":"2024-08-31T12:21:16.375625+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:16.375625+0000","last_undegraded":"2024-08-31T12:21:16.375625+0000","last_fullsized":"2024-08-31T12:21:16.375625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:03:05.060570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372650+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:21:16.372650+0000","last_peered":"2024-08-31T12:21:16.372650+0000","last_clean":"2024-08-31T12:21:16.372650+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:16.372650+0000","last_undegraded":"2024-08-31T12:21:16.372650+0000","last_fullsized":"2024-08-31T12:21:16.372650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069904+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:21:17.069904+0000","last_peered":"2024-08-31T12:21:17.069904+0000","last_clean":"2024-08-31T12:21:17.069904+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:17.069904+0000","last_undegraded":"2024-08-31T12:21:17.069904+0000","last_fullsized":"2024-08-31T12:21:17.069904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'297","reported_seq":2436,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373348+0000","last_change":"2024-08-31T12:19:51.191472+0000","last_active":"2024-08-31T12:21:16.373348+0000","last_peered":"2024-08-31T12:21:16.373348+0000","last_clean":"2024-08-31T12:21:16.373348+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:21:16.373348+0000","last_undegraded":"2024-08-31T12:21:16.373348+0000","last_fullsized":"2024-08-31T12:21:16.373348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:24.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":296,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"43'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373325+0000","last_change":"2024-08-31T12:19:51.189350+0000","last_active":"2024-08-31T12:21:16.373325+0000","last_peered":"2024-08-31T12:21:16.373325+0000","last_clean":"2024-08-31T12:21:16.373325+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:16.373325+0000","last_undegraded":"2024-08-31T12:21:16.373325+0000","last_fullsized":"2024-08-31T12:21:16.373325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:23.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815807+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:21:16.815807+0000","last_peered":"2024-08-31T12:21:16.815807+0000","last_clean":"2024-08-31T12:21:16.815807+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:16.815807+0000","last_undegraded":"2024-08-31T12:21:16.815807+0000","last_fullsized":"2024-08-31T12:21:16.815807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'342","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069573+0000","last_change":"2024-08-31T12:19:51.265682+0000","last_active":"2024-08-31T12:21:17.069573+0000","last_peered":"2024-08-31T12:21:17.069573+0000","last_clean":"2024-08-31T12:21:17.069573+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:21:17.069573+0000","last_undegraded":"2024-08-31T12:21:17.069573+0000","last_fullsized":"2024-08-31T12:21:17.069573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:39.107402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":8388848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":341,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"53'91","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971618+0000","last_change":"2024-08-31T12:19:50.894692+0000","last_active":"2024-08-31T12:21:16.971618+0000","last_peered":"2024-08-31T12:21:16.971618+0000","last_clean":"2024-08-31T12:21:16.971618+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:16.971618+0000","last_undegraded":"2024-08-31T12:21:16.971618+0000","last_fullsized":"2024-08-31T12:21:16.971618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:20.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"42'21","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375268+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:21:21.375268+0000","last_peered":"2024-08-31T12:21:21.375268+0000","last_clean":"2024-08-31T12:21:21.375268+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:21.375268+0000","last_undegraded":"2024-08-31T12:21:21.375268+0000","last_fullsized":"2024-08-31T12:21:21.375268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'321","reported_seq":2466,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071963+0000","last_change":"2024-08-31T12:19:51.075472+0000","last_active":"2024-08-31T12:21:17.071963+0000","last_peered":"2024-08-31T12:21:17.071963+0000","last_clean":"2024-08-31T12:21:17.071963+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:21:17.071963+0000","last_undegraded":"2024-08-31T12:21:17.071963+0000","last_fullsized":"2024-08-31T12:21:17.071963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:35.585043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":8388797,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":321,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971192+0000","last_change":"2024-08-31T12:19:50.894566+0000","last_active":"2024-08-31T12:21:16.971192+0000","last_peered":"2024-08-31T12:21:16.971192+0000","last_clean":"2024-08-31T12:21:16.971192+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:16.971192+0000","last_undegraded":"2024-08-31T12:21:16.971192+0000","last_fullsized":"2024-08-31T12:21:16.971192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:28.837600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"37'106","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.232778+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:21:22.232778+0000","last_peered":"2024-08-31T12:21:22.232778+0000","last_clean":"2024-08-31T12:21:22.232778+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:22.232778+0000","last_undegraded":"2024-08-31T12:21:22.232778+0000","last_fullsized":"2024-08-31T12:21:22.232778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'343","reported_seq":2483,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371775+0000","last_change":"2024-08-31T12:19:51.190295+0000","last_active":"2024-08-31T12:21:16.371775+0000","last_peered":"2024-08-31T12:21:16.371775+0000","last_clean":"2024-08-31T12:21:16.371775+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:21:16.371775+0000","last_undegraded":"2024-08-31T12:21:16.371775+0000","last_fullsized":"2024-08-31T12:21:16.371775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:44.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":8388631,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":343,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'60","reported_seq":2174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070778+0000","last_change":"2024-08-31T12:19:51.271925+0000","last_active":"2024-08-31T12:21:17.070778+0000","last_peered":"2024-08-31T12:21:17.070778+0000","last_clean":"2024-08-31T12:21:17.070778+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:17.070778+0000","last_undegraded":"2024-08-31T12:21:17.070778+0000","last_fullsized":"2024-08-31T12:21:17.070778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:14.676715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"41'18","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.373103+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:21:21.373103+0000","last_peered":"2024-08-31T12:21:21.373103+0000","last_clean":"2024-08-31T12:21:21.373103+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:21.373103+0000","last_undegraded":"2024-08-31T12:21:21.373103+0000","last_fullsized":"2024-08-31T12:21:21.373103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'359","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070204+0000","last_change":"2024-08-31T12:19:51.220620+0000","last_active":"2024-08-31T12:21:17.070204+0000","last_peered":"2024-08-31T12:21:17.070204+0000","last_clean":"2024-08-31T12:21:17.070204+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:17.070204+0000","last_undegraded":"2024-08-31T12:21:17.070204+0000","last_fullsized":"2024-08-31T12:21:17.070204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:46.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":25166248,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":4137,"num_write":357,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"42'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371907+0000","last_change":"2024-08-31T12:19:51.184941+0000","last_active":"2024-08-31T12:21:16.371907+0000","last_peered":"2024-08-31T12:21:16.371907+0000","last_clean":"2024-08-31T12:21:16.371907+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:21:16.371907+0000","last_undegraded":"2024-08-31T12:21:16.371907+0000","last_fullsized":"2024-08-31T12:21:16.371907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:58:57.275553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'298","reported_seq":409,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.865457+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:21:40.865457+0000","last_peered":"2024-08-31T12:21:40.865457+0000","last_clean":"2024-08-31T12:21:40.865457+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:40.865457+0000","last_undegraded":"2024-08-31T12:21:40.865457+0000","last_fullsized":"2024-08-31T12:21:40.865457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2502,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073988+0000","last_change":"2024-08-31T12:19:51.076234+0000","last_active":"2024-08-31T12:21:17.073988+0000","last_peered":"2024-08-31T12:21:17.073988+0000","last_clean":"2024-08-31T12:21:17.073988+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:21:17.073988+0000","last_undegraded":"2024-08-31T12:21:17.073988+0000","last_fullsized":"2024-08-31T12:21:17.073988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.257551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"52'82","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068921+0000","last_change":"2024-08-31T12:19:51.214608+0000","last_active":"2024-08-31T12:21:17.068921+0000","last_peered":"2024-08-31T12:21:17.068921+0000","last_clean":"2024-08-31T12:21:17.068921+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:17.068921+0000","last_undegraded":"2024-08-31T12:21:17.068921+0000","last_fullsized":"2024-08-31T12:21:17.068921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:32:41.739624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"42'2","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971165+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:21:16.971165+0000","last_peered":"2024-08-31T12:21:16.971165+0000","last_clean":"2024-08-31T12:21:16.971165+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:16.971165+0000","last_undegraded":"2024-08-31T12:21:16.971165+0000","last_fullsized":"2024-08-31T12:21:16.971165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'314","reported_seq":2462,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074834+0000","last_change":"2024-08-31T12:19:51.076307+0000","last_active":"2024-08-31T12:21:17.074834+0000","last_peered":"2024-08-31T12:21:17.074834+0000","last_clean":"2024-08-31T12:21:17.074834+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:21:17.074834+0000","last_undegraded":"2024-08-31T12:21:17.074834+0000","last_fullsized":"2024-08-31T12:21:17.074834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:59.114734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":16777283,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":4133,"num_write":313,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"43'86","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372280+0000","last_change":"2024-08-31T12:19:51.178571+0000","last_active":"2024-08-31T12:21:16.372280+0000","last_peered":"2024-08-31T12:21:16.372280+0000","last_clean":"2024-08-31T12:21:16.372280+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:21:16.372280+0000","last_undegraded":"2024-08-31T12:21:16.372280+0000","last_fullsized":"2024-08-31T12:21:16.372280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:51.393024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372653+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:21:16.372653+0000","last_peered":"2024-08-31T12:21:16.372653+0000","last_clean":"2024-08-31T12:21:16.372653+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:16.372653+0000","last_undegraded":"2024-08-31T12:21:16.372653+0000","last_fullsized":"2024-08-31T12:21:16.372653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'296","reported_seq":2427,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813273+0000","last_change":"2024-08-31T12:19:51.184295+0000","last_active":"2024-08-31T12:21:16.813273+0000","last_peered":"2024-08-31T12:21:16.813273+0000","last_clean":"2024-08-31T12:21:16.813273+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:21:16.813273+0000","last_undegraded":"2024-08-31T12:21:16.813273+0000","last_fullsized":"2024-08-31T12:21:16.813273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:25.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":20971556,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":294,"num_write_kb":28815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"42'76","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813884+0000","last_change":"2024-08-31T12:19:51.175019+0000","last_active":"2024-08-31T12:21:16.813884+0000","last_peered":"2024-08-31T12:21:16.813884+0000","last_clean":"2024-08-31T12:21:16.813884+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:16.813884+0000","last_undegraded":"2024-08-31T12:21:16.813884+0000","last_fullsized":"2024-08-31T12:21:16.813884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:49.573391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"55'128","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.393013+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:21:21.393013+0000","last_peered":"2024-08-31T12:21:21.393013+0000","last_clean":"2024-08-31T12:21:21.393013+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:21.393013+0000","last_undegraded":"2024-08-31T12:21:21.393013+0000","last_fullsized":"2024-08-31T12:21:21.393013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":28697,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'328","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.713623+0000","last_change":"2024-08-31T12:19:51.189127+0000","last_active":"2024-08-31T12:21:21.713623+0000","last_peered":"2024-08-31T12:21:21.713623+0000","last_clean":"2024-08-31T12:21:21.713623+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:21:21.713623+0000","last_undegraded":"2024-08-31T12:21:21.713623+0000","last_fullsized":"2024-08-31T12:21:21.713623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:53.515083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":16779999,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":327,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"55'77","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971494+0000","last_change":"2024-08-31T12:19:50.893633+0000","last_active":"2024-08-31T12:21:16.971494+0000","last_peered":"2024-08-31T12:21:16.971494+0000","last_clean":"2024-08-31T12:21:16.971494+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:21:16.971494+0000","last_undegraded":"2024-08-31T12:21:16.971494+0000","last_fullsized":"2024-08-31T12:21:16.971494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:51:49.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'170","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.766628+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:21:22.766628+0000","last_peered":"2024-08-31T12:21:22.766628+0000","last_clean":"2024-08-31T12:21:22.766628+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:22.766628+0000","last_undegraded":"2024-08-31T12:21:22.766628+0000","last_fullsized":"2024-08-31T12:21:22.766628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":40980,"num_write":164,"num_write_kb":12382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'339","reported_seq":2490,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.961472+0000","last_change":"2024-08-31T12:19:51.048401+0000","last_active":"2024-08-31T12:21:42.961472+0000","last_peered":"2024-08-31T12:21:42.961472+0000","last_clean":"2024-08-31T12:21:42.961472+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:21:42.961472+0000","last_undegraded":"2024-08-31T12:21:42.961472+0000","last_fullsized":"2024-08-31T12:21:42.961472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:17.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":336,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"43'74","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372641+0000","last_change":"2024-08-31T12:19:51.177535+0000","last_active":"2024-08-31T12:21:16.372641+0000","last_peered":"2024-08-31T12:21:16.372641+0000","last_clean":"2024-08-31T12:21:16.372641+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:21:16.372641+0000","last_undegraded":"2024-08-31T12:21:16.372641+0000","last_fullsized":"2024-08-31T12:21:16.372641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:22.493379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"55'246","reported_seq":341,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375299+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:21:21.375299+0000","last_peered":"2024-08-31T12:21:21.375299+0000","last_clean":"2024-08-31T12:21:21.375299+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:21.375299+0000","last_undegraded":"2024-08-31T12:21:21.375299+0000","last_fullsized":"2024-08-31T12:21:21.375299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":12304,"num_write":246,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'321","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069076+0000","last_change":"2024-08-31T12:19:51.266455+0000","last_active":"2024-08-31T12:21:17.069076+0000","last_peered":"2024-08-31T12:21:17.069076+0000","last_clean":"2024-08-31T12:21:17.069076+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:21:17.069076+0000","last_undegraded":"2024-08-31T12:21:17.069076+0000","last_fullsized":"2024-08-31T12:21:17.069076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:41.440357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":4194377,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":320,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"55'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.076053+0000","last_change":"2024-08-31T12:19:51.078268+0000","last_active":"2024-08-31T12:21:17.076053+0000","last_peered":"2024-08-31T12:21:17.076053+0000","last_clean":"2024-08-31T12:21:17.076053+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:17.076053+0000","last_undegraded":"2024-08-31T12:21:17.076053+0000","last_fullsized":"2024-08-31T12:21:17.076053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:07:38.413894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"55'24","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971098+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:21:16.971098+0000","last_peered":"2024-08-31T12:21:16.971098+0000","last_clean":"2024-08-31T12:21:16.971098+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:16.971098+0000","last_undegraded":"2024-08-31T12:21:16.971098+0000","last_fullsized":"2024-08-31T12:21:16.971098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'351","reported_seq":2491,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.778567+0000","last_change":"2024-08-31T12:19:50.978531+0000","last_active":"2024-08-31T12:21:26.778567+0000","last_peered":"2024-08-31T12:21:26.778567+0000","last_clean":"2024-08-31T12:21:26.778567+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:26.778567+0000","last_undegraded":"2024-08-31T12:21:26.778567+0000","last_fullsized":"2024-08-31T12:21:26.778567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:07.225950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":20971989,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":343,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"43'95","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070548+0000","last_change":"2024-08-31T12:19:51.271132+0000","last_active":"2024-08-31T12:21:17.070548+0000","last_peered":"2024-08-31T12:21:17.070548+0000","last_clean":"2024-08-31T12:21:17.070548+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:17.070548+0000","last_undegraded":"2024-08-31T12:21:17.070548+0000","last_fullsized":"2024-08-31T12:21:17.070548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:14.931872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"55'4","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071309+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:21:17.071309+0000","last_peered":"2024-08-31T12:21:17.071309+0000","last_clean":"2024-08-31T12:21:17.071309+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:17.071309+0000","last_undegraded":"2024-08-31T12:21:17.071309+0000","last_fullsized":"2024-08-31T12:21:17.071309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'336","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.901080+0000","last_change":"2024-08-31T12:19:51.051597+0000","last_active":"2024-08-31T12:21:42.901080+0000","last_peered":"2024-08-31T12:21:42.901080+0000","last_clean":"2024-08-31T12:21:42.901080+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:21:42.901080+0000","last_undegraded":"2024-08-31T12:21:42.901080+0000","last_fullsized":"2024-08-31T12:21:42.901080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:20.640303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":1440,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":336,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2458,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.919644+0000","last_change":"2024-08-31T12:19:51.050547+0000","last_active":"2024-08-31T12:21:42.919644+0000","last_peered":"2024-08-31T12:21:42.919644+0000","last_clean":"2024-08-31T12:21:42.919644+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:21:42.919644+0000","last_undegraded":"2024-08-31T12:21:42.919644+0000","last_fullsized":"2024-08-31T12:21:42.919644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:21:34.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"52'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380649+0000","last_change":"2024-08-31T12:19:51.051914+0000","last_active":"2024-08-31T12:21:16.380649+0000","last_peered":"2024-08-31T12:21:16.380649+0000","last_clean":"2024-08-31T12:21:16.380649+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:16.380649+0000","last_undegraded":"2024-08-31T12:21:16.380649+0000","last_fullsized":"2024-08-31T12:21:16.380649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:40.077019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"33'221","reported_seq":311,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.134511+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:21:22.134511+0000","last_peered":"2024-08-31T12:21:22.134511+0000","last_clean":"2024-08-31T12:21:22.134511+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:21:22.134511+0000","last_undegraded":"2024-08-31T12:21:22.134511+0000","last_fullsized":"2024-08-31T12:21:22.134511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'323","reported_seq":2465,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373191+0000","last_change":"2024-08-31T12:19:51.192804+0000","last_active":"2024-08-31T12:21:16.373191+0000","last_peered":"2024-08-31T12:21:16.373191+0000","last_clean":"2024-08-31T12:21:16.373191+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:21:16.373191+0000","last_undegraded":"2024-08-31T12:21:16.373191+0000","last_fullsized":"2024-08-31T12:21:16.373191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:57.886915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":322,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"43'101","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072765+0000","last_change":"2024-08-31T12:19:51.068760+0000","last_active":"2024-08-31T12:21:17.072765+0000","last_peered":"2024-08-31T12:21:17.072765+0000","last_clean":"2024-08-31T12:21:17.072765+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:17.072765+0000","last_undegraded":"2024-08-31T12:21:17.072765+0000","last_fullsized":"2024-08-31T12:21:17.072765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:04.217251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"42'24","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812502+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:21:16.812502+0000","last_peered":"2024-08-31T12:21:16.812502+0000","last_clean":"2024-08-31T12:21:16.812502+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:16.812502+0000","last_undegraded":"2024-08-31T12:21:16.812502+0000","last_fullsized":"2024-08-31T12:21:16.812502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"42'102","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.366771+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:21:22.366771+0000","last_peered":"2024-08-31T12:21:22.366771+0000","last_clean":"2024-08-31T12:21:22.366771+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:22.366771+0000","last_undegraded":"2024-08-31T12:21:22.366771+0000","last_fullsized":"2024-08-31T12:21:22.366771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"53'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377386+0000","last_change":"2024-08-31T12:19:51.051245+0000","last_active":"2024-08-31T12:21:16.377386+0000","last_peered":"2024-08-31T12:21:16.377386+0000","last_clean":"2024-08-31T12:21:16.377386+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:21:16.377386+0000","last_undegraded":"2024-08-31T12:21:16.377386+0000","last_fullsized":"2024-08-31T12:21:16.377386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:46:59.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'303","reported_seq":2437,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.934583+0000","last_change":"2024-08-31T12:19:51.050599+0000","last_active":"2024-08-31T12:21:42.934583+0000","last_peered":"2024-08-31T12:21:42.934583+0000","last_clean":"2024-08-31T12:21:42.934583+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:21:42.934583+0000","last_undegraded":"2024-08-31T12:21:42.934583+0000","last_fullsized":"2024-08-31T12:21:42.934583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:25:39.529445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":6071,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":302,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"42'57","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073470+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:21:17.073470+0000","last_peered":"2024-08-31T12:21:17.073470+0000","last_clean":"2024-08-31T12:21:17.073470+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:17.073470+0000","last_undegraded":"2024-08-31T12:21:17.073470+0000","last_fullsized":"2024-08-31T12:21:17.073470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070496+0000","last_change":"2024-08-31T12:19:51.221287+0000","last_active":"2024-08-31T12:21:17.070496+0000","last_peered":"2024-08-31T12:21:17.070496+0000","last_clean":"2024-08-31T12:21:17.070496+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:17.070496+0000","last_undegraded":"2024-08-31T12:21:17.070496+0000","last_fullsized":"2024-08-31T12:21:17.070496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:26.700201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'319","reported_seq":2471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:20.767973+0000","last_change":"2024-08-31T12:19:50.983158+0000","last_active":"2024-08-31T12:21:20.767973+0000","last_peered":"2024-08-31T12:21:20.767973+0000","last_clean":"2024-08-31T12:21:20.767973+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:21:20.767973+0000","last_undegraded":"2024-08-31T12:21:20.767973+0000","last_fullsized":"2024-08-31T12:21:20.767973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.643813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":8388700,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":8234,"num_write":317,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"53'99","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068480+0000","last_change":"2024-08-31T12:19:51.269244+0000","last_active":"2024-08-31T12:21:17.068480+0000","last_peered":"2024-08-31T12:21:17.068480+0000","last_clean":"2024-08-31T12:21:17.068480+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:17.068480+0000","last_undegraded":"2024-08-31T12:21:17.068480+0000","last_fullsized":"2024-08-31T12:21:17.068480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:56.132161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377445+0000","last_change":"2024-08-31T12:19:50.981299+0000","last_active":"2024-08-31T12:21:16.377445+0000","last_peered":"2024-08-31T12:21:16.377445+0000","last_clean":"2024-08-31T12:21:16.377445+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:16.377445+0000","last_undegraded":"2024-08-31T12:21:16.377445+0000","last_fullsized":"2024-08-31T12:21:16.377445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:35.055501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"42'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371976+0000","last_change":"2024-08-31T12:19:51.186593+0000","last_active":"2024-08-31T12:21:16.371976+0000","last_peered":"2024-08-31T12:21:16.371976+0000","last_clean":"2024-08-31T12:21:16.371976+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:21:16.371976+0000","last_undegraded":"2024-08-31T12:21:16.371976+0000","last_fullsized":"2024-08-31T12:21:16.371976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:04.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"43'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071803+0000","last_change":"2024-08-31T12:19:51.074951+0000","last_active":"2024-08-31T12:21:17.071803+0000","last_peered":"2024-08-31T12:21:17.071803+0000","last_clean":"2024-08-31T12:21:17.071803+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:17.071803+0000","last_undegraded":"2024-08-31T12:21:17.071803+0000","last_fullsized":"2024-08-31T12:21:17.071803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:59:00.684606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815095+0000","last_change":"2024-08-31T12:19:51.185342+0000","last_active":"2024-08-31T12:21:16.815095+0000","last_peered":"2024-08-31T12:21:16.815095+0000","last_clean":"2024-08-31T12:21:16.815095+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:16.815095+0000","last_undegraded":"2024-08-31T12:21:16.815095+0000","last_fullsized":"2024-08-31T12:21:16.815095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:43.897575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"55'68","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813330+0000","last_change":"2024-08-31T12:19:51.181704+0000","last_active":"2024-08-31T12:21:16.813330+0000","last_peered":"2024-08-31T12:21:16.813330+0000","last_clean":"2024-08-31T12:21:16.813330+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:16.813330+0000","last_undegraded":"2024-08-31T12:21:16.813330+0000","last_fullsized":"2024-08-31T12:21:16.813330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.178489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"43'94","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070274+0000","last_change":"2024-08-31T12:19:51.271453+0000","last_active":"2024-08-31T12:21:17.070274+0000","last_peered":"2024-08-31T12:21:17.070274+0000","last_clean":"2024-08-31T12:21:17.070274+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:17.070274+0000","last_undegraded":"2024-08-31T12:21:17.070274+0000","last_fullsized":"2024-08-31T12:21:17.070274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:08:45.605808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"43'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074459+0000","last_change":"2024-08-31T12:19:51.078039+0000","last_active":"2024-08-31T12:21:17.074459+0000","last_peered":"2024-08-31T12:21:17.074459+0000","last_clean":"2024-08-31T12:21:17.074459+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:21:17.074459+0000","last_undegraded":"2024-08-31T12:21:17.074459+0000","last_fullsized":"2024-08-31T12:21:17.074459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:29.368356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"55'86","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372412+0000","last_change":"2024-08-31T12:19:51.186883+0000","last_active":"2024-08-31T12:21:16.372412+0000","last_peered":"2024-08-31T12:21:16.372412+0000","last_clean":"2024-08-31T12:21:16.372412+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:21:16.372412+0000","last_undegraded":"2024-08-31T12:21:16.372412+0000","last_fullsized":"2024-08-31T12:21:16.372412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:08.504264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"42'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071591+0000","last_change":"2024-08-31T12:19:51.064708+0000","last_active":"2024-08-31T12:21:17.071591+0000","last_peered":"2024-08-31T12:21:17.071591+0000","last_clean":"2024-08-31T12:21:17.071591+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:21:17.071591+0000","last_undegraded":"2024-08-31T12:21:17.071591+0000","last_fullsized":"2024-08-31T12:21:17.071591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:09.085855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"55'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070101+0000","last_change":"2024-08-31T12:19:51.223300+0000","last_active":"2024-08-31T12:21:17.070101+0000","last_peered":"2024-08-31T12:21:17.070101+0000","last_clean":"2024-08-31T12:21:17.070101+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:17.070101+0000","last_undegraded":"2024-08-31T12:21:17.070101+0000","last_fullsized":"2024-08-31T12:21:17.070101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:32:18.034547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"55'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:51.048787+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:11:02.319788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"43'89","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971033+0000","last_change":"2024-08-31T12:19:50.893976+0000","last_active":"2024-08-31T12:21:16.971033+0000","last_peered":"2024-08-31T12:21:16.971033+0000","last_clean":"2024-08-31T12:21:16.971033+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:21:16.971033+0000","last_undegraded":"2024-08-31T12:21:16.971033+0000","last_fullsized":"2024-08-31T12:21:16.971033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:31.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373594+0000","last_change":"2024-08-31T12:19:51.192143+0000","last_active":"2024-08-31T12:21:16.373594+0000","last_peered":"2024-08-31T12:21:16.373594+0000","last_clean":"2024-08-31T12:21:16.373594+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:21:16.373594+0000","last_undegraded":"2024-08-31T12:21:16.373594+0000","last_fullsized":"2024-08-31T12:21:16.373594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:03:48.542655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"52'79","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380351+0000","last_change":"2024-08-31T12:19:50.982520+0000","last_active":"2024-08-31T12:21:16.380351+0000","last_peered":"2024-08-31T12:21:16.380351+0000","last_clean":"2024-08-31T12:21:16.380351+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:16.380351+0000","last_undegraded":"2024-08-31T12:21:16.380351+0000","last_fullsized":"2024-08-31T12:21:16.380351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:34.588788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"55'87","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373374+0000","last_change":"2024-08-31T12:19:51.192768+0000","last_active":"2024-08-31T12:21:16.373374+0000","last_peered":"2024-08-31T12:21:16.373374+0000","last_clean":"2024-08-31T12:21:16.373374+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:21:16.373374+0000","last_undegraded":"2024-08-31T12:21:16.373374+0000","last_fullsized":"2024-08-31T12:21:16.373374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:39.267549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"55'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371884+0000","last_change":"2024-08-31T12:19:51.185985+0000","last_active":"2024-08-31T12:21:16.371884+0000","last_peered":"2024-08-31T12:21:16.371884+0000","last_clean":"2024-08-31T12:21:16.371884+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:21:16.371884+0000","last_undegraded":"2024-08-31T12:21:16.371884+0000","last_fullsized":"2024-08-31T12:21:16.371884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:21.405555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"43'78","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071149+0000","last_change":"2024-08-31T12:19:51.063460+0000","last_active":"2024-08-31T12:21:17.071149+0000","last_peered":"2024-08-31T12:21:17.071149+0000","last_clean":"2024-08-31T12:21:17.071149+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:21:17.071149+0000","last_undegraded":"2024-08-31T12:21:17.071149+0000","last_fullsized":"2024-08-31T12:21:17.071149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:33.292394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"43'85","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812455+0000","last_change":"2024-08-31T12:19:51.174772+0000","last_active":"2024-08-31T12:21:16.812455+0000","last_peered":"2024-08-31T12:21:16.812455+0000","last_clean":"2024-08-31T12:21:16.812455+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:21:16.812455+0000","last_undegraded":"2024-08-31T12:21:16.812455+0000","last_fullsized":"2024-08-31T12:21:16.812455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:54:29.129773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"44'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812860+0000","last_change":"2024-08-31T12:19:51.181127+0000","last_active":"2024-08-31T12:21:16.812860+0000","last_peered":"2024-08-31T12:21:16.812860+0000","last_clean":"2024-08-31T12:21:16.812860+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:21:16.812860+0000","last_undegraded":"2024-08-31T12:21:16.812860+0000","last_fullsized":"2024-08-31T12:21:16.812860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.484043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"45'69","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970992+0000","last_change":"2024-08-31T12:19:50.892823+0000","last_active":"2024-08-31T12:21:16.970992+0000","last_peered":"2024-08-31T12:21:16.970992+0000","last_clean":"2024-08-31T12:21:16.970992+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:21:16.970992+0000","last_undegraded":"2024-08-31T12:21:16.970992+0000","last_fullsized":"2024-08-31T12:21:16.970992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:37.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"43'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971068+0000","last_change":"2024-08-31T12:19:50.893929+0000","last_active":"2024-08-31T12:21:16.971068+0000","last_peered":"2024-08-31T12:21:16.971068+0000","last_clean":"2024-08-31T12:21:16.971068+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:21:16.971068+0000","last_undegraded":"2024-08-31T12:21:16.971068+0000","last_fullsized":"2024-08-31T12:21:16.971068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:33.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970963+0000","last_change":"2024-08-31T12:19:50.894286+0000","last_active":"2024-08-31T12:21:16.970963+0000","last_peered":"2024-08-31T12:21:16.970963+0000","last_clean":"2024-08-31T12:21:16.970963+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:16.970963+0000","last_undegraded":"2024-08-31T12:21:16.970963+0000","last_fullsized":"2024-08-31T12:21:16.970963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:11.536744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071275+0000","last_change":"2024-08-31T12:19:51.225674+0000","last_active":"2024-08-31T12:21:17.071275+0000","last_peered":"2024-08-31T12:21:17.071275+0000","last_clean":"2024-08-31T12:21:17.071275+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:17.071275+0000","last_undegraded":"2024-08-31T12:21:17.071275+0000","last_fullsized":"2024-08-31T12:21:17.071275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:58.545098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"47'65","reported_seq":2179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071120+0000","last_change":"2024-08-31T12:19:51.040117+0000","last_active":"2024-08-31T12:21:17.071120+0000","last_peered":"2024-08-31T12:21:17.071120+0000","last_clean":"2024-08-31T12:21:17.071120+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:17.071120+0000","last_undegraded":"2024-08-31T12:21:17.071120+0000","last_fullsized":"2024-08-31T12:21:17.071120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:02.594079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"55'100","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970362+0000","last_change":"2024-08-31T12:19:50.892284+0000","last_active":"2024-08-31T12:21:16.970362+0000","last_peered":"2024-08-31T12:21:16.970362+0000","last_clean":"2024-08-31T12:21:16.970362+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:16.970362+0000","last_undegraded":"2024-08-31T12:21:16.970362+0000","last_fullsized":"2024-08-31T12:21:16.970362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:08:03.924404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"42'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069723+0000","last_change":"2024-08-31T12:19:51.267262+0000","last_active":"2024-08-31T12:21:17.069723+0000","last_peered":"2024-08-31T12:21:17.069723+0000","last_clean":"2024-08-31T12:21:17.069723+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:17.069723+0000","last_undegraded":"2024-08-31T12:21:17.069723+0000","last_fullsized":"2024-08-31T12:21:17.069723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:43.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970549+0000","last_change":"2024-08-31T12:19:50.893034+0000","last_active":"2024-08-31T12:21:16.970549+0000","last_peered":"2024-08-31T12:21:16.970549+0000","last_clean":"2024-08-31T12:21:16.970549+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:16.970549+0000","last_undegraded":"2024-08-31T12:21:16.970549+0000","last_fullsized":"2024-08-31T12:21:16.970549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:43.248554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"52'67","reported_seq":2181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069464+0000","last_change":"2024-08-31T12:19:51.264462+0000","last_active":"2024-08-31T12:21:17.069464+0000","last_peered":"2024-08-31T12:21:17.069464+0000","last_clean":"2024-08-31T12:21:17.069464+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:17.069464+0000","last_undegraded":"2024-08-31T12:21:17.069464+0000","last_fullsized":"2024-08-31T12:21:17.069464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:42.905157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"45'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072984+0000","last_change":"2024-08-31T12:19:51.075411+0000","last_active":"2024-08-31T12:21:17.072984+0000","last_peered":"2024-08-31T12:21:17.072984+0000","last_clean":"2024-08-31T12:21:17.072984+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:21:17.072984+0000","last_undegraded":"2024-08-31T12:21:17.072984+0000","last_fullsized":"2024-08-31T12:21:17.072984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:36.650512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"55'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073271+0000","last_change":"2024-08-31T12:19:51.075045+0000","last_active":"2024-08-31T12:21:17.073271+0000","last_peered":"2024-08-31T12:21:17.073271+0000","last_clean":"2024-08-31T12:21:17.073271+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:21:17.073271+0000","last_undegraded":"2024-08-31T12:21:17.073271+0000","last_fullsized":"2024-08-31T12:21:17.073271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:45.340712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970900+0000","last_change":"2024-08-31T12:19:50.894206+0000","last_active":"2024-08-31T12:21:16.970900+0000","last_peered":"2024-08-31T12:21:16.970900+0000","last_clean":"2024-08-31T12:21:16.970900+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:21:16.970900+0000","last_undegraded":"2024-08-31T12:21:16.970900+0000","last_fullsized":"2024-08-31T12:21:16.970900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:36:32.545870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":348156025,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":1140,"num_read_kb":65823,"num_write":10676,"num_write_kb":540068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":719446016,"data_stored":719446016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10729,"ondisk_log_size":10729,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5266,"ondisk_log_size":5266,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144490859,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":468,"num_read_kb":466026,"num_write":4533,"num_write_kb":144462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":288231424,"data_stored":288166153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4365,"ondisk_log_size":4365,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246080,"kb_used_data":134384,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94125760,"statfs":{"total":96636764160,"available":96384778240,"internally_reserved":0,"allocated":137609216,"data_stored":137294400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221172,"kb_used_data":135844,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94150668,"statfs":{"total":96636764160,"available":96410284032,"internally_reserved":0,"allocated":139104256,"data_stored":138799761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207900,"kb_used_data":122572,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94163940,"statfs":{"total":96636764160,"available":96423874560,"internally_reserved":0,"allocated":125513728,"data_stored":125195328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241528,"kb_used_data":160360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94130312,"statfs":{"total":96636764160,"available":96389439488,"internally_reserved":0,"allocated":164208640,"data_stored":163900631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83098055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201140,"kb_used_data":129700,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94170700,"statfs":{"total":96636764160,"available":96430796800,"internally_reserved":0,"allocated":132812800,"data_stored":132500785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244472,"kb_used_data":146664,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94127368,"statfs":{"total":96636764160,"available":96386424832,"internally_reserved":0,"allocated":150183936,"data_stored":149871863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197516,"kb_used_data":121916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94174324,"statfs":{"total":96636764160,"available":96434507776,"internally_reserved":0,"allocated":124841984,"data_stored":124525942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128324,"kb_used_data":38836,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243516,"statfs":{"total":96636764160,"available":96505360384,"internally_reserved":0,"allocated":39768064,"data_stored":39445579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55029760,"data_stored":55018213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39075840,"data_stored":39057850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34140160,"data_stored":34129807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25751552,"data_stored":25741231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69165056,"data_stored":69165056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115384320,"data_stored":115384320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106991616,"data_stored":106991616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109031424,"data_stored":109031424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":45056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90132480,"data_stored":90132480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":117485568,"data_stored":117485568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":111210496,"data_stored":111210496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:21:46.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T12:21:46.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:21:46.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 -- 172.21.15.164:0/777366813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc920153440 msgr2=0x7fc9200c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 --2- 172.21.15.164:0/777366813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc920153440 0x7fc9200c8620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc920070e70 tx=0x7fc91001f0f0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 -- 172.21.15.164:0/777366813 shutdown_connections 2024-08-31T12:21:46.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 --2- 172.21.15.164:0/777366813 >> v2:172.21.15.184:3300/0 conn(0x7fc920159d90 0x7fc9200c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 --2- 172.21.15.164:0/777366813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc920153440 0x7fc9200c8620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 -- 172.21.15.164:0/777366813 >> 172.21.15.164:0/777366813 conn(0x7fc920071f20 msgr2=0x7fc920072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 -- 172.21.15.164:0/777366813 shutdown_connections 2024-08-31T12:21:46.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.335+0000 7fc926000640 1 -- 172.21.15.164:0/777366813 wait complete. 2024-08-31T12:21:46.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 Processor -- start 2024-08-31T12:21:46.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- start start 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200c7330 0x7fc9200cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc920153440 0x7fc9200c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc920070980 con 0x7fc920159d90 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9200706a0 con 0x7fc920153440 2024-08-31T12:21:46.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc9200b9230 con 0x7fc9200c7330 2024-08-31T12:21:46.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc924c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200c7330 0x7fc9200cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47326/0 (socket says 172.21.15.164:47326) 2024-08-31T12:21:46.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 -- 172.21.15.164:0/907450430 learned_addr learned my addr 172.21.15.164:0/907450430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:46.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc917e00640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc920153440 0x7fc9200c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 -- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200c7330 msgr2=0x7fc9200cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200c7330 0x7fc9200cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 -- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc920153440 msgr2=0x7fc9200c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc920153440 0x7fc9200c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 -- 172.21.15.164:0/907450430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9200ccef0 con 0x7fc920159d90 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc925600640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc91800eae0 tx=0x7fc918009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91800cde0 con 0x7fc920159d90 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc918004c20 con 0x7fc920159d90 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918005020 con 0x7fc920159d90 2024-08-31T12:21:46.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9200cd820 con 0x7fc920159d90 2024-08-31T12:21:46.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.339+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc920147ea0 con 0x7fc920159d90 2024-08-31T12:21:46.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920153850 con 0x7fc920159d90 2024-08-31T12:21:46.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc9180051c0 con 0x7fc920159d90 2024-08-31T12:21:46.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc91d600640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 0x7fc8fc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fc918093dd0 con 0x7fc920159d90 2024-08-31T12:21:46.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc924c00640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 0x7fc8fc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.343+0000 7fc924c00640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 0x7fc8fc074600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9100b2000 tx=0x7fc91001d930 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.347+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc91805f120 con 0x7fc920159d90 2024-08-31T12:21:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.511+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc920149d80 con 0x7fc8fc0720f0 2024-08-31T12:21:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc91d600640 1 -- 172.21.15.164:0/907450430 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336098 (secure 0 0 0) 0x7fc920149d80 con 0x7fc8fc0720f0 2024-08-31T12:21:46.533 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:46.536 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 msgr2=0x7fc8fc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 0x7fc8fc074600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9100b2000 tx=0x7fc91001d930 comp rx=0 tx=0).stop 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 msgr2=0x7fc9201464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc91800eae0 tx=0x7fc918009f70 comp rx=0 tx=0).stop 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 shutdown_connections 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc8fc0720f0 0x7fc8fc074600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc920159d90 0x7fc9201464e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc920153440 0x7fc9200c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 --2- 172.21.15.164:0/907450430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200c7330 0x7fc9200cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 >> 172.21.15.164:0/907450430 conn(0x7fc920071f20 msgr2=0x7fc9201e2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 shutdown_connections 2024-08-31T12:21:46.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.531+0000 7fc926000640 1 -- 172.21.15.164:0/907450430 wait complete. 2024-08-31T12:21:46.555 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-08-31T12:21:44.755442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":493237252,"num_objects":166,"num_object_clones":0,"num_object_copies":544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":1674,"num_read_kb":531904,"num_write":15310,"num_write_kb":686158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20432,"ondisk_log_size":20432,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1688132,"kb_used_data":990276,"kb_used_omap":12,"kb_used_meta":697715,"kb_avail":753286588,"statfs":{"total":773094113280,"available":771365466112,"internally_reserved":0,"allocated":1014042624,"data_stored":1011534289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":714460721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-66121297,"num_objects":-17,"num_object_clones":0,"num_object_copies":-68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":78,"num_write_kb":828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006353"},"pg_stats":[{"pgid":"2.1f","version":"56'59","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.855289+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:21:23.855289+0000","last_peered":"2024-08-31T12:21:23.855289+0000","last_clean":"2024-08-31T12:21:23.855289+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:23.855289+0000","last_undegraded":"2024-08-31T12:21:23.855289+0000","last_fullsized":"2024-08-31T12:21:23.855289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"43'87","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074630+0000","last_change":"2024-08-31T12:19:51.077673+0000","last_active":"2024-08-31T12:21:17.074630+0000","last_peered":"2024-08-31T12:21:17.074630+0000","last_clean":"2024-08-31T12:21:17.074630+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:17.074630+0000","last_undegraded":"2024-08-31T12:21:17.074630+0000","last_fullsized":"2024-08-31T12:21:17.074630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:27.050879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"55'363","reported_seq":2506,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:50.981608+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:24:47.867907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":360,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"55'81","reported_seq":171,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074838+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:21:17.074838+0000","last_peered":"2024-08-31T12:21:17.074838+0000","last_clean":"2024-08-31T12:21:17.074838+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:21:17.074838+0000","last_undegraded":"2024-08-31T12:21:17.074838+0000","last_fullsized":"2024-08-31T12:21:17.074838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"47'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.075830+0000","last_change":"2024-08-31T12:19:51.078041+0000","last_active":"2024-08-31T12:21:17.075830+0000","last_peered":"2024-08-31T12:21:17.075830+0000","last_clean":"2024-08-31T12:21:17.075830+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:21:17.075830+0000","last_undegraded":"2024-08-31T12:21:17.075830+0000","last_fullsized":"2024-08-31T12:21:17.075830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:40.429055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'344","reported_seq":2486,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068332+0000","last_change":"2024-08-31T12:19:51.270521+0000","last_active":"2024-08-31T12:21:17.068332+0000","last_peered":"2024-08-31T12:21:17.068332+0000","last_clean":"2024-08-31T12:21:17.068332+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:21:17.068332+0000","last_undegraded":"2024-08-31T12:21:17.068332+0000","last_fullsized":"2024-08-31T12:21:17.068332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:42:30.397283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":343,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"55'1937","reported_seq":2035,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.403350+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:21:21.403350+0000","last_peered":"2024-08-31T12:21:21.403350+0000","last_clean":"2024-08-31T12:21:21.403350+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:21:21.403350+0000","last_undegraded":"2024-08-31T12:21:21.403350+0000","last_fullsized":"2024-08-31T12:21:21.403350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":38900,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"53'81","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070461+0000","last_change":"2024-08-31T12:19:51.222939+0000","last_active":"2024-08-31T12:21:17.070461+0000","last_peered":"2024-08-31T12:21:17.070461+0000","last_clean":"2024-08-31T12:21:17.070461+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:17.070461+0000","last_undegraded":"2024-08-31T12:21:17.070461+0000","last_fullsized":"2024-08-31T12:21:17.070461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:45.439283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"55'365","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.265557+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:34.207533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":364,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"55'49","reported_seq":139,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971951+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:21:16.971951+0000","last_peered":"2024-08-31T12:21:16.971951+0000","last_clean":"2024-08-31T12:21:16.971951+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:16.971951+0000","last_undegraded":"2024-08-31T12:21:16.971951+0000","last_fullsized":"2024-08-31T12:21:16.971951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372884+0000","last_change":"2024-08-31T12:19:51.191343+0000","last_active":"2024-08-31T12:21:16.372884+0000","last_peered":"2024-08-31T12:21:16.372884+0000","last_clean":"2024-08-31T12:21:16.372884+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:21:16.372884+0000","last_undegraded":"2024-08-31T12:21:16.372884+0000","last_fullsized":"2024-08-31T12:21:16.372884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:55.638854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"55'331","reported_seq":2474,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068734+0000","last_change":"2024-08-31T12:19:51.266908+0000","last_active":"2024-08-31T12:21:17.068734+0000","last_peered":"2024-08-31T12:21:17.068734+0000","last_clean":"2024-08-31T12:21:17.068734+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:21:17.068734+0000","last_undegraded":"2024-08-31T12:21:17.068734+0000","last_fullsized":"2024-08-31T12:21:17.068734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:53.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":331,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372070+0000","last_change":"2024-08-31T12:19:51.182717+0000","last_active":"2024-08-31T12:21:16.372070+0000","last_peered":"2024-08-31T12:21:16.372070+0000","last_clean":"2024-08-31T12:21:16.372070+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:16.372070+0000","last_undegraded":"2024-08-31T12:21:16.372070+0000","last_fullsized":"2024-08-31T12:21:16.372070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:02:01.902388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"55'85","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.385266+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:21:21.385266+0000","last_peered":"2024-08-31T12:21:21.385266+0000","last_clean":"2024-08-31T12:21:21.385266+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:21.385266+0000","last_undegraded":"2024-08-31T12:21:21.385266+0000","last_fullsized":"2024-08-31T12:21:21.385266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'335","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970562+0000","last_change":"2024-08-31T12:19:50.893218+0000","last_active":"2024-08-31T12:21:16.970562+0000","last_peered":"2024-08-31T12:21:16.970562+0000","last_clean":"2024-08-31T12:21:16.970562+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:21:16.970562+0000","last_undegraded":"2024-08-31T12:21:16.970562+0000","last_fullsized":"2024-08-31T12:21:16.970562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:26.717821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":334,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'80","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.379462+0000","last_change":"2024-08-31T12:19:50.981970+0000","last_active":"2024-08-31T12:21:16.379462+0000","last_peered":"2024-08-31T12:21:16.379462+0000","last_clean":"2024-08-31T12:21:16.379462+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:16.379462+0000","last_undegraded":"2024-08-31T12:21:16.379462+0000","last_fullsized":"2024-08-31T12:21:16.379462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:50:55.324238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"42'23","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815017+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:21:16.815017+0000","last_peered":"2024-08-31T12:21:16.815017+0000","last_clean":"2024-08-31T12:21:16.815017+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:16.815017+0000","last_undegraded":"2024-08-31T12:21:16.815017+0000","last_fullsized":"2024-08-31T12:21:16.815017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"55'362","reported_seq":2505,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970380+0000","last_change":"2024-08-31T12:19:50.893757+0000","last_active":"2024-08-31T12:21:16.970380+0000","last_peered":"2024-08-31T12:21:16.970380+0000","last_clean":"2024-08-31T12:21:16.970380+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:21:16.970380+0000","last_undegraded":"2024-08-31T12:21:16.970380+0000","last_fullsized":"2024-08-31T12:21:16.970380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:38:01.625027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":359,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373448+0000","last_change":"2024-08-31T12:19:51.043981+0000","last_active":"2024-08-31T12:21:16.373448+0000","last_peered":"2024-08-31T12:21:16.373448+0000","last_clean":"2024-08-31T12:21:16.373448+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:21:16.373448+0000","last_undegraded":"2024-08-31T12:21:16.373448+0000","last_fullsized":"2024-08-31T12:21:16.373448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:13.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'86","reported_seq":172,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.779627+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:21:42.779627+0000","last_peered":"2024-08-31T12:21:42.779627+0000","last_clean":"2024-08-31T12:21:42.779627+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:21:42.779627+0000","last_undegraded":"2024-08-31T12:21:42.779627+0000","last_fullsized":"2024-08-31T12:21:42.779627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307770,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":82,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'335","reported_seq":2485,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380280+0000","last_change":"2024-08-31T12:19:50.982738+0000","last_active":"2024-08-31T12:21:16.380280+0000","last_peered":"2024-08-31T12:21:16.380280+0000","last_clean":"2024-08-31T12:21:16.380280+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:16.380280+0000","last_undegraded":"2024-08-31T12:21:16.380280+0000","last_fullsized":"2024-08-31T12:21:16.380280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:27:32.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":8232,"num_write":331,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"53'92","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371986+0000","last_change":"2024-08-31T12:19:51.179971+0000","last_active":"2024-08-31T12:21:16.371986+0000","last_peered":"2024-08-31T12:21:16.371986+0000","last_clean":"2024-08-31T12:21:16.371986+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:16.371986+0000","last_undegraded":"2024-08-31T12:21:16.371986+0000","last_fullsized":"2024-08-31T12:21:16.371986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:49:48.420577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'8","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970212+0000","last_change":"2024-08-31T12:13:45.671766+0000","last_active":"2024-08-31T12:21:16.970212+0000","last_peered":"2024-08-31T12:21:16.970212+0000","last_clean":"2024-08-31T12:21:16.970212+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:16.970212+0000","last_undegraded":"2024-08-31T12:21:16.970212+0000","last_fullsized":"2024-08-31T12:21:16.970212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:37.962507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"55'281","reported_seq":2426,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069212+0000","last_change":"2024-08-31T12:19:51.271430+0000","last_active":"2024-08-31T12:21:17.069212+0000","last_peered":"2024-08-31T12:21:17.069212+0000","last_clean":"2024-08-31T12:21:17.069212+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:17.069212+0000","last_undegraded":"2024-08-31T12:21:17.069212+0000","last_fullsized":"2024-08-31T12:21:17.069212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:12.164256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":4132,"num_write":279,"num_write_kb":16521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.383778+0000","last_change":"2024-08-31T12:19:51.049750+0000","last_active":"2024-08-31T12:21:16.383778+0000","last_peered":"2024-08-31T12:21:16.383778+0000","last_clean":"2024-08-31T12:21:16.383778+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:16.383778+0000","last_undegraded":"2024-08-31T12:21:16.383778+0000","last_fullsized":"2024-08-31T12:21:16.383778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:52.154694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'8","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.852975+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:21:23.852975+0000","last_peered":"2024-08-31T12:21:23.852975+0000","last_clean":"2024-08-31T12:21:23.852975+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:23.852975+0000","last_undegraded":"2024-08-31T12:21:23.852975+0000","last_fullsized":"2024-08-31T12:21:23.852975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'356","reported_seq":2492,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068333+0000","last_change":"2024-08-31T12:19:51.267348+0000","last_active":"2024-08-31T12:21:17.068333+0000","last_peered":"2024-08-31T12:21:17.068333+0000","last_clean":"2024-08-31T12:21:17.068333+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:17.068333+0000","last_undegraded":"2024-08-31T12:21:17.068333+0000","last_fullsized":"2024-08-31T12:21:17.068333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:52:51.279879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":20972894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":354,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"55'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.382991+0000","last_change":"2024-08-31T12:19:51.047806+0000","last_active":"2024-08-31T12:21:16.382991+0000","last_peered":"2024-08-31T12:21:16.382991+0000","last_clean":"2024-08-31T12:21:16.382991+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:16.382991+0000","last_undegraded":"2024-08-31T12:21:16.382991+0000","last_fullsized":"2024-08-31T12:21:16.382991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:27:44.404451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'168","reported_seq":258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.852923+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:21:41.852923+0000","last_peered":"2024-08-31T12:21:41.852923+0000","last_clean":"2024-08-31T12:21:41.852923+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:41.852923+0000","last_undegraded":"2024-08-31T12:21:41.852923+0000","last_fullsized":"2024-08-31T12:21:41.852923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":409,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'357","reported_seq":2514,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.920444+0000","last_change":"2024-08-31T12:19:51.044689+0000","last_active":"2024-08-31T12:21:42.920444+0000","last_peered":"2024-08-31T12:21:42.920444+0000","last_clean":"2024-08-31T12:21:42.920444+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:21:42.920444+0000","last_undegraded":"2024-08-31T12:21:42.920444+0000","last_fullsized":"2024-08-31T12:21:42.920444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:00:11.862454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":1492,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":355,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"43'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815142+0000","last_change":"2024-08-31T12:19:51.184067+0000","last_active":"2024-08-31T12:21:16.815142+0000","last_peered":"2024-08-31T12:21:16.815142+0000","last_clean":"2024-08-31T12:21:16.815142+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:16.815142+0000","last_undegraded":"2024-08-31T12:21:16.815142+0000","last_fullsized":"2024-08-31T12:21:16.815142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:03.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"42'21","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373694+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:21:16.373694+0000","last_peered":"2024-08-31T12:21:16.373694+0000","last_clean":"2024-08-31T12:21:16.373694+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:16.373694+0000","last_undegraded":"2024-08-31T12:21:16.373694+0000","last_fullsized":"2024-08-31T12:21:16.373694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'367","reported_seq":2507,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.787456+0000","last_change":"2024-08-31T12:19:51.178915+0000","last_active":"2024-08-31T12:21:26.787456+0000","last_peered":"2024-08-31T12:21:26.787456+0000","last_clean":"2024-08-31T12:21:26.787456+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:21:26.787456+0000","last_undegraded":"2024-08-31T12:21:26.787456+0000","last_fullsized":"2024-08-31T12:21:26.787456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:55.684998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":20971859,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":367,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"43'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068933+0000","last_change":"2024-08-31T12:19:51.267618+0000","last_active":"2024-08-31T12:21:17.068933+0000","last_peered":"2024-08-31T12:21:17.068933+0000","last_clean":"2024-08-31T12:21:17.068933+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:17.068933+0000","last_undegraded":"2024-08-31T12:21:17.068933+0000","last_fullsized":"2024-08-31T12:21:17.068933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:57.623085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'2","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072705+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:21:17.072705+0000","last_peered":"2024-08-31T12:21:17.072705+0000","last_clean":"2024-08-31T12:21:17.072705+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:17.072705+0000","last_undegraded":"2024-08-31T12:21:17.072705+0000","last_fullsized":"2024-08-31T12:21:17.072705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'351","reported_seq":2493,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812483+0000","last_change":"2024-08-31T12:19:51.175945+0000","last_active":"2024-08-31T12:21:16.812483+0000","last_peered":"2024-08-31T12:21:16.812483+0000","last_clean":"2024-08-31T12:21:16.812483+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:21:16.812483+0000","last_undegraded":"2024-08-31T12:21:16.812483+0000","last_fullsized":"2024-08-31T12:21:16.812483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:03:44.835939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":4199202,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":350,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"53'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970407+0000","last_change":"2024-08-31T12:19:50.892454+0000","last_active":"2024-08-31T12:21:16.970407+0000","last_peered":"2024-08-31T12:21:16.970407+0000","last_clean":"2024-08-31T12:21:16.970407+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:16.970407+0000","last_undegraded":"2024-08-31T12:21:16.970407+0000","last_fullsized":"2024-08-31T12:21:16.970407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:35:26.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'167","reported_seq":256,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.582813+0000","last_change":"2024-08-31T12:13:45.690901+0000","last_active":"2024-08-31T12:21:21.582813+0000","last_peered":"2024-08-31T12:21:21.582813+0000","last_clean":"2024-08-31T12:21:21.582813+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:21.582813+0000","last_undegraded":"2024-08-31T12:21:21.582813+0000","last_fullsized":"2024-08-31T12:21:21.582813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:20.596553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'317","reported_seq":2452,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814080+0000","last_change":"2024-08-31T12:19:51.183892+0000","last_active":"2024-08-31T12:21:16.814080+0000","last_peered":"2024-08-31T12:21:16.814080+0000","last_clean":"2024-08-31T12:21:16.814080+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:21:16.814080+0000","last_undegraded":"2024-08-31T12:21:16.814080+0000","last_fullsized":"2024-08-31T12:21:16.814080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:30.314422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":8393263,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3300,"num_write":317,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071145+0000","last_change":"2024-08-31T12:19:51.049351+0000","last_active":"2024-08-31T12:21:17.071145+0000","last_peered":"2024-08-31T12:21:17.071145+0000","last_clean":"2024-08-31T12:21:17.071145+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:17.071145+0000","last_undegraded":"2024-08-31T12:21:17.071145+0000","last_fullsized":"2024-08-31T12:21:17.071145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:40.766633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"55'141","reported_seq":366,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.378461+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:21:16.378461+0000","last_peered":"2024-08-31T12:21:16.378461+0000","last_clean":"2024-08-31T12:21:16.378461+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:16.378461+0000","last_undegraded":"2024-08-31T12:21:16.378461+0000","last_fullsized":"2024-08-31T12:21:16.378461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575283,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":654,"num_write":137,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"55'330","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.814058+0000","last_change":"2024-08-31T12:19:51.184441+0000","last_active":"2024-08-31T12:21:16.814058+0000","last_peered":"2024-08-31T12:21:16.814058+0000","last_clean":"2024-08-31T12:21:16.814058+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:21:16.814058+0000","last_undegraded":"2024-08-31T12:21:16.814058+0000","last_fullsized":"2024-08-31T12:21:16.814058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:55:53.475438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":329,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"52'77","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812314+0000","last_change":"2024-08-31T12:19:51.182725+0000","last_active":"2024-08-31T12:21:16.812314+0000","last_peered":"2024-08-31T12:21:16.812314+0000","last_clean":"2024-08-31T12:21:16.812314+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:16.812314+0000","last_undegraded":"2024-08-31T12:21:16.812314+0000","last_fullsized":"2024-08-31T12:21:16.812314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:17:40.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'101","reported_seq":192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.798818+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:21:21.798818+0000","last_peered":"2024-08-31T12:21:21.798818+0000","last_clean":"2024-08-31T12:21:21.798818+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:21:21.798818+0000","last_undegraded":"2024-08-31T12:21:21.798818+0000","last_fullsized":"2024-08-31T12:21:21.798818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072317+0000","last_change":"2024-08-31T12:19:51.075766+0000","last_active":"2024-08-31T12:21:17.072317+0000","last_peered":"2024-08-31T12:21:17.072317+0000","last_clean":"2024-08-31T12:21:17.072317+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:21:17.072317+0000","last_undegraded":"2024-08-31T12:21:17.072317+0000","last_fullsized":"2024-08-31T12:21:17.072317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:27.063933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"55'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375625+0000","last_change":"2024-08-31T12:19:51.049809+0000","last_active":"2024-08-31T12:21:16.375625+0000","last_peered":"2024-08-31T12:21:16.375625+0000","last_clean":"2024-08-31T12:21:16.375625+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:16.375625+0000","last_undegraded":"2024-08-31T12:21:16.375625+0000","last_fullsized":"2024-08-31T12:21:16.375625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:03:05.060570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372650+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:21:16.372650+0000","last_peered":"2024-08-31T12:21:16.372650+0000","last_clean":"2024-08-31T12:21:16.372650+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:16.372650+0000","last_undegraded":"2024-08-31T12:21:16.372650+0000","last_fullsized":"2024-08-31T12:21:16.372650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069904+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:21:17.069904+0000","last_peered":"2024-08-31T12:21:17.069904+0000","last_clean":"2024-08-31T12:21:17.069904+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:17.069904+0000","last_undegraded":"2024-08-31T12:21:17.069904+0000","last_fullsized":"2024-08-31T12:21:17.069904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'297","reported_seq":2436,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373348+0000","last_change":"2024-08-31T12:19:51.191472+0000","last_active":"2024-08-31T12:21:16.373348+0000","last_peered":"2024-08-31T12:21:16.373348+0000","last_clean":"2024-08-31T12:21:16.373348+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:21:16.373348+0000","last_undegraded":"2024-08-31T12:21:16.373348+0000","last_fullsized":"2024-08-31T12:21:16.373348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:24.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":296,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"43'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373325+0000","last_change":"2024-08-31T12:19:51.189350+0000","last_active":"2024-08-31T12:21:16.373325+0000","last_peered":"2024-08-31T12:21:16.373325+0000","last_clean":"2024-08-31T12:21:16.373325+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:16.373325+0000","last_undegraded":"2024-08-31T12:21:16.373325+0000","last_fullsized":"2024-08-31T12:21:16.373325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:23.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815807+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:21:16.815807+0000","last_peered":"2024-08-31T12:21:16.815807+0000","last_clean":"2024-08-31T12:21:16.815807+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:16.815807+0000","last_undegraded":"2024-08-31T12:21:16.815807+0000","last_fullsized":"2024-08-31T12:21:16.815807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'342","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069573+0000","last_change":"2024-08-31T12:19:51.265682+0000","last_active":"2024-08-31T12:21:17.069573+0000","last_peered":"2024-08-31T12:21:17.069573+0000","last_clean":"2024-08-31T12:21:17.069573+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:21:17.069573+0000","last_undegraded":"2024-08-31T12:21:17.069573+0000","last_fullsized":"2024-08-31T12:21:17.069573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:39.107402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":8388848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":341,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"53'91","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971618+0000","last_change":"2024-08-31T12:19:50.894692+0000","last_active":"2024-08-31T12:21:16.971618+0000","last_peered":"2024-08-31T12:21:16.971618+0000","last_clean":"2024-08-31T12:21:16.971618+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:16.971618+0000","last_undegraded":"2024-08-31T12:21:16.971618+0000","last_fullsized":"2024-08-31T12:21:16.971618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:20.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"42'21","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375268+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:21:21.375268+0000","last_peered":"2024-08-31T12:21:21.375268+0000","last_clean":"2024-08-31T12:21:21.375268+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:21.375268+0000","last_undegraded":"2024-08-31T12:21:21.375268+0000","last_fullsized":"2024-08-31T12:21:21.375268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'321","reported_seq":2466,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071963+0000","last_change":"2024-08-31T12:19:51.075472+0000","last_active":"2024-08-31T12:21:17.071963+0000","last_peered":"2024-08-31T12:21:17.071963+0000","last_clean":"2024-08-31T12:21:17.071963+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:21:17.071963+0000","last_undegraded":"2024-08-31T12:21:17.071963+0000","last_fullsized":"2024-08-31T12:21:17.071963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:35.585043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":8388797,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":321,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971192+0000","last_change":"2024-08-31T12:19:50.894566+0000","last_active":"2024-08-31T12:21:16.971192+0000","last_peered":"2024-08-31T12:21:16.971192+0000","last_clean":"2024-08-31T12:21:16.971192+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:16.971192+0000","last_undegraded":"2024-08-31T12:21:16.971192+0000","last_fullsized":"2024-08-31T12:21:16.971192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:28.837600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"37'106","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.232778+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:21:22.232778+0000","last_peered":"2024-08-31T12:21:22.232778+0000","last_clean":"2024-08-31T12:21:22.232778+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:22.232778+0000","last_undegraded":"2024-08-31T12:21:22.232778+0000","last_fullsized":"2024-08-31T12:21:22.232778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'343","reported_seq":2483,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371775+0000","last_change":"2024-08-31T12:19:51.190295+0000","last_active":"2024-08-31T12:21:16.371775+0000","last_peered":"2024-08-31T12:21:16.371775+0000","last_clean":"2024-08-31T12:21:16.371775+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:21:16.371775+0000","last_undegraded":"2024-08-31T12:21:16.371775+0000","last_fullsized":"2024-08-31T12:21:16.371775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:44.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":8388631,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":343,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'60","reported_seq":2174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070778+0000","last_change":"2024-08-31T12:19:51.271925+0000","last_active":"2024-08-31T12:21:17.070778+0000","last_peered":"2024-08-31T12:21:17.070778+0000","last_clean":"2024-08-31T12:21:17.070778+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:17.070778+0000","last_undegraded":"2024-08-31T12:21:17.070778+0000","last_fullsized":"2024-08-31T12:21:17.070778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:14.676715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"41'18","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.373103+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:21:21.373103+0000","last_peered":"2024-08-31T12:21:21.373103+0000","last_clean":"2024-08-31T12:21:21.373103+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:21.373103+0000","last_undegraded":"2024-08-31T12:21:21.373103+0000","last_fullsized":"2024-08-31T12:21:21.373103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'359","reported_seq":2509,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070204+0000","last_change":"2024-08-31T12:19:51.220620+0000","last_active":"2024-08-31T12:21:17.070204+0000","last_peered":"2024-08-31T12:21:17.070204+0000","last_clean":"2024-08-31T12:21:17.070204+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:17.070204+0000","last_undegraded":"2024-08-31T12:21:17.070204+0000","last_fullsized":"2024-08-31T12:21:17.070204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:46.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":25166248,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":4137,"num_write":357,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"42'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371907+0000","last_change":"2024-08-31T12:19:51.184941+0000","last_active":"2024-08-31T12:21:16.371907+0000","last_peered":"2024-08-31T12:21:16.371907+0000","last_clean":"2024-08-31T12:21:16.371907+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:21:16.371907+0000","last_undegraded":"2024-08-31T12:21:16.371907+0000","last_fullsized":"2024-08-31T12:21:16.371907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:58:57.275553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'298","reported_seq":409,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.865457+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:21:40.865457+0000","last_peered":"2024-08-31T12:21:40.865457+0000","last_clean":"2024-08-31T12:21:40.865457+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:40.865457+0000","last_undegraded":"2024-08-31T12:21:40.865457+0000","last_fullsized":"2024-08-31T12:21:40.865457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2502,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073988+0000","last_change":"2024-08-31T12:19:51.076234+0000","last_active":"2024-08-31T12:21:17.073988+0000","last_peered":"2024-08-31T12:21:17.073988+0000","last_clean":"2024-08-31T12:21:17.073988+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:21:17.073988+0000","last_undegraded":"2024-08-31T12:21:17.073988+0000","last_fullsized":"2024-08-31T12:21:17.073988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.257551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"52'82","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068921+0000","last_change":"2024-08-31T12:19:51.214608+0000","last_active":"2024-08-31T12:21:17.068921+0000","last_peered":"2024-08-31T12:21:17.068921+0000","last_clean":"2024-08-31T12:21:17.068921+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:17.068921+0000","last_undegraded":"2024-08-31T12:21:17.068921+0000","last_fullsized":"2024-08-31T12:21:17.068921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:32:41.739624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"42'2","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971165+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:21:16.971165+0000","last_peered":"2024-08-31T12:21:16.971165+0000","last_clean":"2024-08-31T12:21:16.971165+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:16.971165+0000","last_undegraded":"2024-08-31T12:21:16.971165+0000","last_fullsized":"2024-08-31T12:21:16.971165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'314","reported_seq":2462,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074834+0000","last_change":"2024-08-31T12:19:51.076307+0000","last_active":"2024-08-31T12:21:17.074834+0000","last_peered":"2024-08-31T12:21:17.074834+0000","last_clean":"2024-08-31T12:21:17.074834+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:21:17.074834+0000","last_undegraded":"2024-08-31T12:21:17.074834+0000","last_fullsized":"2024-08-31T12:21:17.074834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:59.114734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":16777283,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":4133,"num_write":313,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"43'86","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372280+0000","last_change":"2024-08-31T12:19:51.178571+0000","last_active":"2024-08-31T12:21:16.372280+0000","last_peered":"2024-08-31T12:21:16.372280+0000","last_clean":"2024-08-31T12:21:16.372280+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:21:16.372280+0000","last_undegraded":"2024-08-31T12:21:16.372280+0000","last_fullsized":"2024-08-31T12:21:16.372280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:51.393024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372653+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:21:16.372653+0000","last_peered":"2024-08-31T12:21:16.372653+0000","last_clean":"2024-08-31T12:21:16.372653+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:16.372653+0000","last_undegraded":"2024-08-31T12:21:16.372653+0000","last_fullsized":"2024-08-31T12:21:16.372653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'296","reported_seq":2427,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813273+0000","last_change":"2024-08-31T12:19:51.184295+0000","last_active":"2024-08-31T12:21:16.813273+0000","last_peered":"2024-08-31T12:21:16.813273+0000","last_clean":"2024-08-31T12:21:16.813273+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:21:16.813273+0000","last_undegraded":"2024-08-31T12:21:16.813273+0000","last_fullsized":"2024-08-31T12:21:16.813273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:25.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":20971556,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":294,"num_write_kb":28815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"42'76","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813884+0000","last_change":"2024-08-31T12:19:51.175019+0000","last_active":"2024-08-31T12:21:16.813884+0000","last_peered":"2024-08-31T12:21:16.813884+0000","last_clean":"2024-08-31T12:21:16.813884+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:16.813884+0000","last_undegraded":"2024-08-31T12:21:16.813884+0000","last_fullsized":"2024-08-31T12:21:16.813884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:49.573391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"55'128","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.393013+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:21:21.393013+0000","last_peered":"2024-08-31T12:21:21.393013+0000","last_clean":"2024-08-31T12:21:21.393013+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:21.393013+0000","last_undegraded":"2024-08-31T12:21:21.393013+0000","last_fullsized":"2024-08-31T12:21:21.393013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":28697,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'328","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.713623+0000","last_change":"2024-08-31T12:19:51.189127+0000","last_active":"2024-08-31T12:21:21.713623+0000","last_peered":"2024-08-31T12:21:21.713623+0000","last_clean":"2024-08-31T12:21:21.713623+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:21:21.713623+0000","last_undegraded":"2024-08-31T12:21:21.713623+0000","last_fullsized":"2024-08-31T12:21:21.713623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:53.515083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":16779999,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":327,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"55'77","reported_seq":2190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971494+0000","last_change":"2024-08-31T12:19:50.893633+0000","last_active":"2024-08-31T12:21:16.971494+0000","last_peered":"2024-08-31T12:21:16.971494+0000","last_clean":"2024-08-31T12:21:16.971494+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:21:16.971494+0000","last_undegraded":"2024-08-31T12:21:16.971494+0000","last_fullsized":"2024-08-31T12:21:16.971494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:51:49.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'170","reported_seq":276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.766628+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:21:22.766628+0000","last_peered":"2024-08-31T12:21:22.766628+0000","last_clean":"2024-08-31T12:21:22.766628+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:22.766628+0000","last_undegraded":"2024-08-31T12:21:22.766628+0000","last_fullsized":"2024-08-31T12:21:22.766628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":40980,"num_write":164,"num_write_kb":12382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'339","reported_seq":2490,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.961472+0000","last_change":"2024-08-31T12:19:51.048401+0000","last_active":"2024-08-31T12:21:42.961472+0000","last_peered":"2024-08-31T12:21:42.961472+0000","last_clean":"2024-08-31T12:21:42.961472+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:21:42.961472+0000","last_undegraded":"2024-08-31T12:21:42.961472+0000","last_fullsized":"2024-08-31T12:21:42.961472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:17.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":336,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"43'74","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372641+0000","last_change":"2024-08-31T12:19:51.177535+0000","last_active":"2024-08-31T12:21:16.372641+0000","last_peered":"2024-08-31T12:21:16.372641+0000","last_clean":"2024-08-31T12:21:16.372641+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:21:16.372641+0000","last_undegraded":"2024-08-31T12:21:16.372641+0000","last_fullsized":"2024-08-31T12:21:16.372641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:22.493379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"55'246","reported_seq":341,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375299+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:21:21.375299+0000","last_peered":"2024-08-31T12:21:21.375299+0000","last_clean":"2024-08-31T12:21:21.375299+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:21.375299+0000","last_undegraded":"2024-08-31T12:21:21.375299+0000","last_fullsized":"2024-08-31T12:21:21.375299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":12304,"num_write":246,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'321","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069076+0000","last_change":"2024-08-31T12:19:51.266455+0000","last_active":"2024-08-31T12:21:17.069076+0000","last_peered":"2024-08-31T12:21:17.069076+0000","last_clean":"2024-08-31T12:21:17.069076+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:21:17.069076+0000","last_undegraded":"2024-08-31T12:21:17.069076+0000","last_fullsized":"2024-08-31T12:21:17.069076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:41.440357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":4194377,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":320,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"55'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.076053+0000","last_change":"2024-08-31T12:19:51.078268+0000","last_active":"2024-08-31T12:21:17.076053+0000","last_peered":"2024-08-31T12:21:17.076053+0000","last_clean":"2024-08-31T12:21:17.076053+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:17.076053+0000","last_undegraded":"2024-08-31T12:21:17.076053+0000","last_fullsized":"2024-08-31T12:21:17.076053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:07:38.413894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"55'24","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971098+0000","last_change":"2024-08-31T12:13:45.673929+0000","last_active":"2024-08-31T12:21:16.971098+0000","last_peered":"2024-08-31T12:21:16.971098+0000","last_clean":"2024-08-31T12:21:16.971098+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:16.971098+0000","last_undegraded":"2024-08-31T12:21:16.971098+0000","last_fullsized":"2024-08-31T12:21:16.971098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:08.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'351","reported_seq":2491,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:26.778567+0000","last_change":"2024-08-31T12:19:50.978531+0000","last_active":"2024-08-31T12:21:26.778567+0000","last_peered":"2024-08-31T12:21:26.778567+0000","last_clean":"2024-08-31T12:21:26.778567+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:26.778567+0000","last_undegraded":"2024-08-31T12:21:26.778567+0000","last_fullsized":"2024-08-31T12:21:26.778567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:07.225950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":20971989,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":343,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"43'95","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070548+0000","last_change":"2024-08-31T12:19:51.271132+0000","last_active":"2024-08-31T12:21:17.070548+0000","last_peered":"2024-08-31T12:21:17.070548+0000","last_clean":"2024-08-31T12:21:17.070548+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:17.070548+0000","last_undegraded":"2024-08-31T12:21:17.070548+0000","last_fullsized":"2024-08-31T12:21:17.070548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:14.931872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"55'4","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071309+0000","last_change":"2024-08-31T12:13:45.677258+0000","last_active":"2024-08-31T12:21:17.071309+0000","last_peered":"2024-08-31T12:21:17.071309+0000","last_clean":"2024-08-31T12:21:17.071309+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:17.071309+0000","last_undegraded":"2024-08-31T12:21:17.071309+0000","last_fullsized":"2024-08-31T12:21:17.071309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:56.754395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'336","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.901080+0000","last_change":"2024-08-31T12:19:51.051597+0000","last_active":"2024-08-31T12:21:42.901080+0000","last_peered":"2024-08-31T12:21:42.901080+0000","last_clean":"2024-08-31T12:21:42.901080+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:21:42.901080+0000","last_undegraded":"2024-08-31T12:21:42.901080+0000","last_fullsized":"2024-08-31T12:21:42.901080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:20.640303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":1440,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":336,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2458,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.919644+0000","last_change":"2024-08-31T12:19:51.050547+0000","last_active":"2024-08-31T12:21:42.919644+0000","last_peered":"2024-08-31T12:21:42.919644+0000","last_clean":"2024-08-31T12:21:42.919644+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:21:42.919644+0000","last_undegraded":"2024-08-31T12:21:42.919644+0000","last_fullsized":"2024-08-31T12:21:42.919644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:21:34.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"52'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380649+0000","last_change":"2024-08-31T12:19:51.051914+0000","last_active":"2024-08-31T12:21:16.380649+0000","last_peered":"2024-08-31T12:21:16.380649+0000","last_clean":"2024-08-31T12:21:16.380649+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:16.380649+0000","last_undegraded":"2024-08-31T12:21:16.380649+0000","last_fullsized":"2024-08-31T12:21:16.380649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:40.077019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"33'221","reported_seq":311,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.134511+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:21:22.134511+0000","last_peered":"2024-08-31T12:21:22.134511+0000","last_clean":"2024-08-31T12:21:22.134511+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:21:22.134511+0000","last_undegraded":"2024-08-31T12:21:22.134511+0000","last_fullsized":"2024-08-31T12:21:22.134511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'323","reported_seq":2465,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373191+0000","last_change":"2024-08-31T12:19:51.192804+0000","last_active":"2024-08-31T12:21:16.373191+0000","last_peered":"2024-08-31T12:21:16.373191+0000","last_clean":"2024-08-31T12:21:16.373191+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:21:16.373191+0000","last_undegraded":"2024-08-31T12:21:16.373191+0000","last_fullsized":"2024-08-31T12:21:16.373191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:57.886915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":322,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"43'101","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072765+0000","last_change":"2024-08-31T12:19:51.068760+0000","last_active":"2024-08-31T12:21:17.072765+0000","last_peered":"2024-08-31T12:21:17.072765+0000","last_clean":"2024-08-31T12:21:17.072765+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:17.072765+0000","last_undegraded":"2024-08-31T12:21:17.072765+0000","last_fullsized":"2024-08-31T12:21:17.072765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:04.217251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"42'24","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812502+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:21:16.812502+0000","last_peered":"2024-08-31T12:21:16.812502+0000","last_clean":"2024-08-31T12:21:16.812502+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:16.812502+0000","last_undegraded":"2024-08-31T12:21:16.812502+0000","last_fullsized":"2024-08-31T12:21:16.812502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"42'102","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.366771+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:21:22.366771+0000","last_peered":"2024-08-31T12:21:22.366771+0000","last_clean":"2024-08-31T12:21:22.366771+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:22.366771+0000","last_undegraded":"2024-08-31T12:21:22.366771+0000","last_fullsized":"2024-08-31T12:21:22.366771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"53'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377386+0000","last_change":"2024-08-31T12:19:51.051245+0000","last_active":"2024-08-31T12:21:16.377386+0000","last_peered":"2024-08-31T12:21:16.377386+0000","last_clean":"2024-08-31T12:21:16.377386+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:21:16.377386+0000","last_undegraded":"2024-08-31T12:21:16.377386+0000","last_fullsized":"2024-08-31T12:21:16.377386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:46:59.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'303","reported_seq":2437,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.934583+0000","last_change":"2024-08-31T12:19:51.050599+0000","last_active":"2024-08-31T12:21:42.934583+0000","last_peered":"2024-08-31T12:21:42.934583+0000","last_clean":"2024-08-31T12:21:42.934583+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:21:42.934583+0000","last_undegraded":"2024-08-31T12:21:42.934583+0000","last_fullsized":"2024-08-31T12:21:42.934583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:25:39.529445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":6071,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":302,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"42'57","reported_seq":146,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073470+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:21:17.073470+0000","last_peered":"2024-08-31T12:21:17.073470+0000","last_clean":"2024-08-31T12:21:17.073470+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:17.073470+0000","last_undegraded":"2024-08-31T12:21:17.073470+0000","last_fullsized":"2024-08-31T12:21:17.073470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070496+0000","last_change":"2024-08-31T12:19:51.221287+0000","last_active":"2024-08-31T12:21:17.070496+0000","last_peered":"2024-08-31T12:21:17.070496+0000","last_clean":"2024-08-31T12:21:17.070496+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:17.070496+0000","last_undegraded":"2024-08-31T12:21:17.070496+0000","last_fullsized":"2024-08-31T12:21:17.070496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:26.700201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'319","reported_seq":2471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:20.767973+0000","last_change":"2024-08-31T12:19:50.983158+0000","last_active":"2024-08-31T12:21:20.767973+0000","last_peered":"2024-08-31T12:21:20.767973+0000","last_clean":"2024-08-31T12:21:20.767973+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:21:20.767973+0000","last_undegraded":"2024-08-31T12:21:20.767973+0000","last_fullsized":"2024-08-31T12:21:20.767973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.643813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":8388700,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":8234,"num_write":317,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"53'99","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.068480+0000","last_change":"2024-08-31T12:19:51.269244+0000","last_active":"2024-08-31T12:21:17.068480+0000","last_peered":"2024-08-31T12:21:17.068480+0000","last_clean":"2024-08-31T12:21:17.068480+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:17.068480+0000","last_undegraded":"2024-08-31T12:21:17.068480+0000","last_fullsized":"2024-08-31T12:21:17.068480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:56.132161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.377445+0000","last_change":"2024-08-31T12:19:50.981299+0000","last_active":"2024-08-31T12:21:16.377445+0000","last_peered":"2024-08-31T12:21:16.377445+0000","last_clean":"2024-08-31T12:21:16.377445+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:16.377445+0000","last_undegraded":"2024-08-31T12:21:16.377445+0000","last_fullsized":"2024-08-31T12:21:16.377445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:35.055501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"42'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371976+0000","last_change":"2024-08-31T12:19:51.186593+0000","last_active":"2024-08-31T12:21:16.371976+0000","last_peered":"2024-08-31T12:21:16.371976+0000","last_clean":"2024-08-31T12:21:16.371976+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:21:16.371976+0000","last_undegraded":"2024-08-31T12:21:16.371976+0000","last_fullsized":"2024-08-31T12:21:16.371976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:04.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"43'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071803+0000","last_change":"2024-08-31T12:19:51.074951+0000","last_active":"2024-08-31T12:21:17.071803+0000","last_peered":"2024-08-31T12:21:17.071803+0000","last_clean":"2024-08-31T12:21:17.071803+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:17.071803+0000","last_undegraded":"2024-08-31T12:21:17.071803+0000","last_fullsized":"2024-08-31T12:21:17.071803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:59:00.684606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"43'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815095+0000","last_change":"2024-08-31T12:19:51.185342+0000","last_active":"2024-08-31T12:21:16.815095+0000","last_peered":"2024-08-31T12:21:16.815095+0000","last_clean":"2024-08-31T12:21:16.815095+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:16.815095+0000","last_undegraded":"2024-08-31T12:21:16.815095+0000","last_fullsized":"2024-08-31T12:21:16.815095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:43.897575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"55'68","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.813330+0000","last_change":"2024-08-31T12:19:51.181704+0000","last_active":"2024-08-31T12:21:16.813330+0000","last_peered":"2024-08-31T12:21:16.813330+0000","last_clean":"2024-08-31T12:21:16.813330+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:16.813330+0000","last_undegraded":"2024-08-31T12:21:16.813330+0000","last_fullsized":"2024-08-31T12:21:16.813330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.178489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"43'94","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070274+0000","last_change":"2024-08-31T12:19:51.271453+0000","last_active":"2024-08-31T12:21:17.070274+0000","last_peered":"2024-08-31T12:21:17.070274+0000","last_clean":"2024-08-31T12:21:17.070274+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:17.070274+0000","last_undegraded":"2024-08-31T12:21:17.070274+0000","last_fullsized":"2024-08-31T12:21:17.070274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:08:45.605808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"43'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.074459+0000","last_change":"2024-08-31T12:19:51.078039+0000","last_active":"2024-08-31T12:21:17.074459+0000","last_peered":"2024-08-31T12:21:17.074459+0000","last_clean":"2024-08-31T12:21:17.074459+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:21:17.074459+0000","last_undegraded":"2024-08-31T12:21:17.074459+0000","last_fullsized":"2024-08-31T12:21:17.074459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:29.368356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"55'86","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372412+0000","last_change":"2024-08-31T12:19:51.186883+0000","last_active":"2024-08-31T12:21:16.372412+0000","last_peered":"2024-08-31T12:21:16.372412+0000","last_clean":"2024-08-31T12:21:16.372412+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:21:16.372412+0000","last_undegraded":"2024-08-31T12:21:16.372412+0000","last_fullsized":"2024-08-31T12:21:16.372412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:08.504264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"42'84","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071591+0000","last_change":"2024-08-31T12:19:51.064708+0000","last_active":"2024-08-31T12:21:17.071591+0000","last_peered":"2024-08-31T12:21:17.071591+0000","last_clean":"2024-08-31T12:21:17.071591+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:21:17.071591+0000","last_undegraded":"2024-08-31T12:21:17.071591+0000","last_fullsized":"2024-08-31T12:21:17.071591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:09.085855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"55'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.070101+0000","last_change":"2024-08-31T12:19:51.223300+0000","last_active":"2024-08-31T12:21:17.070101+0000","last_peered":"2024-08-31T12:21:17.070101+0000","last_clean":"2024-08-31T12:21:17.070101+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:17.070101+0000","last_undegraded":"2024-08-31T12:21:17.070101+0000","last_fullsized":"2024-08-31T12:21:17.070101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:32:18.034547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"55'79","reported_seq":2193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.375922+0000","last_change":"2024-08-31T12:19:51.048787+0000","last_active":"2024-08-31T12:21:16.375922+0000","last_peered":"2024-08-31T12:21:16.375922+0000","last_clean":"2024-08-31T12:21:16.375922+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:21:16.375922+0000","last_undegraded":"2024-08-31T12:21:16.375922+0000","last_fullsized":"2024-08-31T12:21:16.375922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:11:02.319788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"43'89","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971033+0000","last_change":"2024-08-31T12:19:50.893976+0000","last_active":"2024-08-31T12:21:16.971033+0000","last_peered":"2024-08-31T12:21:16.971033+0000","last_clean":"2024-08-31T12:21:16.971033+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:21:16.971033+0000","last_undegraded":"2024-08-31T12:21:16.971033+0000","last_fullsized":"2024-08-31T12:21:16.971033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:31.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373594+0000","last_change":"2024-08-31T12:19:51.192143+0000","last_active":"2024-08-31T12:21:16.373594+0000","last_peered":"2024-08-31T12:21:16.373594+0000","last_clean":"2024-08-31T12:21:16.373594+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:21:16.373594+0000","last_undegraded":"2024-08-31T12:21:16.373594+0000","last_fullsized":"2024-08-31T12:21:16.373594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:03:48.542655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"52'79","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.380351+0000","last_change":"2024-08-31T12:19:50.982520+0000","last_active":"2024-08-31T12:21:16.380351+0000","last_peered":"2024-08-31T12:21:16.380351+0000","last_clean":"2024-08-31T12:21:16.380351+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:16.380351+0000","last_undegraded":"2024-08-31T12:21:16.380351+0000","last_fullsized":"2024-08-31T12:21:16.380351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:34.588788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"55'87","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.373374+0000","last_change":"2024-08-31T12:19:51.192768+0000","last_active":"2024-08-31T12:21:16.373374+0000","last_peered":"2024-08-31T12:21:16.373374+0000","last_clean":"2024-08-31T12:21:16.373374+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:21:16.373374+0000","last_undegraded":"2024-08-31T12:21:16.373374+0000","last_fullsized":"2024-08-31T12:21:16.373374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:39.267549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"55'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.371884+0000","last_change":"2024-08-31T12:19:51.185985+0000","last_active":"2024-08-31T12:21:16.371884+0000","last_peered":"2024-08-31T12:21:16.371884+0000","last_clean":"2024-08-31T12:21:16.371884+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:21:16.371884+0000","last_undegraded":"2024-08-31T12:21:16.371884+0000","last_fullsized":"2024-08-31T12:21:16.371884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:21.405555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"43'78","reported_seq":2192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071149+0000","last_change":"2024-08-31T12:19:51.063460+0000","last_active":"2024-08-31T12:21:17.071149+0000","last_peered":"2024-08-31T12:21:17.071149+0000","last_clean":"2024-08-31T12:21:17.071149+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:21:17.071149+0000","last_undegraded":"2024-08-31T12:21:17.071149+0000","last_fullsized":"2024-08-31T12:21:17.071149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:33.292394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"43'85","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812455+0000","last_change":"2024-08-31T12:19:51.174772+0000","last_active":"2024-08-31T12:21:16.812455+0000","last_peered":"2024-08-31T12:21:16.812455+0000","last_clean":"2024-08-31T12:21:16.812455+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:21:16.812455+0000","last_undegraded":"2024-08-31T12:21:16.812455+0000","last_fullsized":"2024-08-31T12:21:16.812455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:54:29.129773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"44'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812860+0000","last_change":"2024-08-31T12:19:51.181127+0000","last_active":"2024-08-31T12:21:16.812860+0000","last_peered":"2024-08-31T12:21:16.812860+0000","last_clean":"2024-08-31T12:21:16.812860+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:21:16.812860+0000","last_undegraded":"2024-08-31T12:21:16.812860+0000","last_fullsized":"2024-08-31T12:21:16.812860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.484043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"45'69","reported_seq":2182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970992+0000","last_change":"2024-08-31T12:19:50.892823+0000","last_active":"2024-08-31T12:21:16.970992+0000","last_peered":"2024-08-31T12:21:16.970992+0000","last_clean":"2024-08-31T12:21:16.970992+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:21:16.970992+0000","last_undegraded":"2024-08-31T12:21:16.970992+0000","last_fullsized":"2024-08-31T12:21:16.970992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:37.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"43'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971068+0000","last_change":"2024-08-31T12:19:50.893929+0000","last_active":"2024-08-31T12:21:16.971068+0000","last_peered":"2024-08-31T12:21:16.971068+0000","last_clean":"2024-08-31T12:21:16.971068+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:21:16.971068+0000","last_undegraded":"2024-08-31T12:21:16.971068+0000","last_fullsized":"2024-08-31T12:21:16.971068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:33.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"42'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970963+0000","last_change":"2024-08-31T12:19:50.894286+0000","last_active":"2024-08-31T12:21:16.970963+0000","last_peered":"2024-08-31T12:21:16.970963+0000","last_clean":"2024-08-31T12:21:16.970963+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:16.970963+0000","last_undegraded":"2024-08-31T12:21:16.970963+0000","last_fullsized":"2024-08-31T12:21:16.970963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:11.536744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"55'73","reported_seq":2186,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071275+0000","last_change":"2024-08-31T12:19:51.225674+0000","last_active":"2024-08-31T12:21:17.071275+0000","last_peered":"2024-08-31T12:21:17.071275+0000","last_clean":"2024-08-31T12:21:17.071275+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:17.071275+0000","last_undegraded":"2024-08-31T12:21:17.071275+0000","last_fullsized":"2024-08-31T12:21:17.071275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:58.545098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"47'65","reported_seq":2179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.071120+0000","last_change":"2024-08-31T12:19:51.040117+0000","last_active":"2024-08-31T12:21:17.071120+0000","last_peered":"2024-08-31T12:21:17.071120+0000","last_clean":"2024-08-31T12:21:17.071120+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:17.071120+0000","last_undegraded":"2024-08-31T12:21:17.071120+0000","last_fullsized":"2024-08-31T12:21:17.071120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:02.594079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"55'100","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970362+0000","last_change":"2024-08-31T12:19:50.892284+0000","last_active":"2024-08-31T12:21:16.970362+0000","last_peered":"2024-08-31T12:21:16.970362+0000","last_clean":"2024-08-31T12:21:16.970362+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:16.970362+0000","last_undegraded":"2024-08-31T12:21:16.970362+0000","last_fullsized":"2024-08-31T12:21:16.970362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:08:03.924404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"42'86","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069723+0000","last_change":"2024-08-31T12:19:51.267262+0000","last_active":"2024-08-31T12:21:17.069723+0000","last_peered":"2024-08-31T12:21:17.069723+0000","last_clean":"2024-08-31T12:21:17.069723+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:17.069723+0000","last_undegraded":"2024-08-31T12:21:17.069723+0000","last_fullsized":"2024-08-31T12:21:17.069723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:43.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"43'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970549+0000","last_change":"2024-08-31T12:19:50.893034+0000","last_active":"2024-08-31T12:21:16.970549+0000","last_peered":"2024-08-31T12:21:16.970549+0000","last_clean":"2024-08-31T12:21:16.970549+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:16.970549+0000","last_undegraded":"2024-08-31T12:21:16.970549+0000","last_fullsized":"2024-08-31T12:21:16.970549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:43.248554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"52'67","reported_seq":2181,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069464+0000","last_change":"2024-08-31T12:19:51.264462+0000","last_active":"2024-08-31T12:21:17.069464+0000","last_peered":"2024-08-31T12:21:17.069464+0000","last_clean":"2024-08-31T12:21:17.069464+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:17.069464+0000","last_undegraded":"2024-08-31T12:21:17.069464+0000","last_fullsized":"2024-08-31T12:21:17.069464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:42.905157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"45'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072984+0000","last_change":"2024-08-31T12:19:51.075411+0000","last_active":"2024-08-31T12:21:17.072984+0000","last_peered":"2024-08-31T12:21:17.072984+0000","last_clean":"2024-08-31T12:21:17.072984+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:21:17.072984+0000","last_undegraded":"2024-08-31T12:21:17.072984+0000","last_fullsized":"2024-08-31T12:21:17.072984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:36.650512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"55'71","reported_seq":2185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073271+0000","last_change":"2024-08-31T12:19:51.075045+0000","last_active":"2024-08-31T12:21:17.073271+0000","last_peered":"2024-08-31T12:21:17.073271+0000","last_clean":"2024-08-31T12:21:17.073271+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:21:17.073271+0000","last_undegraded":"2024-08-31T12:21:17.073271+0000","last_fullsized":"2024-08-31T12:21:17.073271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:45.340712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"43'78","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.970900+0000","last_change":"2024-08-31T12:19:50.894206+0000","last_active":"2024-08-31T12:21:16.970900+0000","last_peered":"2024-08-31T12:21:16.970900+0000","last_clean":"2024-08-31T12:21:16.970900+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:21:16.970900+0000","last_undegraded":"2024-08-31T12:21:16.970900+0000","last_fullsized":"2024-08-31T12:21:16.970900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:36:32.545870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":348156025,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":1140,"num_read_kb":65823,"num_write":10676,"num_write_kb":540068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":719446016,"data_stored":719446016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10729,"ondisk_log_size":10729,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5266,"ondisk_log_size":5266,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144490859,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":468,"num_read_kb":466026,"num_write":4533,"num_write_kb":144462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":288231424,"data_stored":288166153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4365,"ondisk_log_size":4365,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246080,"kb_used_data":134384,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94125760,"statfs":{"total":96636764160,"available":96384778240,"internally_reserved":0,"allocated":137609216,"data_stored":137294400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221172,"kb_used_data":135844,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94150668,"statfs":{"total":96636764160,"available":96410284032,"internally_reserved":0,"allocated":139104256,"data_stored":138799761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207900,"kb_used_data":122572,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94163940,"statfs":{"total":96636764160,"available":96423874560,"internally_reserved":0,"allocated":125513728,"data_stored":125195328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241528,"kb_used_data":160360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94130312,"statfs":{"total":96636764160,"available":96389439488,"internally_reserved":0,"allocated":164208640,"data_stored":163900631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83098055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201140,"kb_used_data":129700,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94170700,"statfs":{"total":96636764160,"available":96430796800,"internally_reserved":0,"allocated":132812800,"data_stored":132500785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244472,"kb_used_data":146664,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94127368,"statfs":{"total":96636764160,"available":96386424832,"internally_reserved":0,"allocated":150183936,"data_stored":149871863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197516,"kb_used_data":121916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94174324,"statfs":{"total":96636764160,"available":96434507776,"internally_reserved":0,"allocated":124841984,"data_stored":124525942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128324,"kb_used_data":38836,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243516,"statfs":{"total":96636764160,"available":96505360384,"internally_reserved":0,"allocated":39768064,"data_stored":39445579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55029760,"data_stored":55018213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39075840,"data_stored":39057850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34140160,"data_stored":34129807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25751552,"data_stored":25741231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69165056,"data_stored":69165056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115384320,"data_stored":115384320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106991616,"data_stored":106991616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109031424,"data_stored":109031424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":45056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90132480,"data_stored":90132480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":117485568,"data_stored":117485568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":111210496,"data_stored":111210496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:21:46.563 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:21:46.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- 172.21.15.164:0/3504521412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f415c410 msgr2=0x7f99f40c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- 172.21.15.164:0/3504521412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f415c410 0x7f99f40c92c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009840 tx=0x7f99e001c820 comp rx=0 tx=0).stop 2024-08-31T12:21:46.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- 172.21.15.164:0/3504521412 shutdown_connections 2024-08-31T12:21:46.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- 172.21.15.164:0/3504521412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f415c410 0x7f99f40c92c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- 172.21.15.164:0/3504521412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f414efb0 0x7f99f415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- 172.21.15.164:0/3504521412 >> 172.21.15.164:0/3504521412 conn(0x7f99f4072590 msgr2=0x7f99f40cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- 172.21.15.164:0/3504521412 shutdown_connections 2024-08-31T12:21:46.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- 172.21.15.164:0/3504521412 wait complete. 2024-08-31T12:21:46.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 Processor -- start 2024-08-31T12:21:46.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- start start 2024-08-31T12:21:46.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99f414efb0 0x7f99f415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f415c410 0x7f99f40ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40c7820 con 0x7f99f40c9800 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40c4b60 con 0x7f99f414efb0 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.755+0000 7f99f9800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f99f40c79a0 con 0x7f99f415c410 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47330/0 (socket says 172.21.15.164:47330) 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 -- 172.21.15.164:0/1355559330 learned_addr learned my addr 172.21.15.164:0/1355559330 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f3400640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f415c410 0x7f99f40ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2000640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99f414efb0 0x7f99f415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 -- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f415c410 msgr2=0x7f99f40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f415c410 0x7f99f40ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 -- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99f414efb0 msgr2=0x7f99f415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99f414efb0 0x7f99f415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 -- 172.21.15.164:0/1355559330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f415a080 con 0x7f99f40c9800 2024-08-31T12:21:46.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f2a00640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f99e400d950 tx=0x7f99e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4017070 con 0x7f99f40c9800 2024-08-31T12:21:46.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99e4009d20 con 0x7f99f40c9800 2024-08-31T12:21:46.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f4142cf0 con 0x7f99f40c9800 2024-08-31T12:21:46.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e40106c0 con 0x7f99f40c9800 2024-08-31T12:21:46.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f4142fd0 con 0x7f99f40c9800 2024-08-31T12:21:46.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f40c81f0 con 0x7f99f40c9800 2024-08-31T12:21:46.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.759+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f99e401a070 con 0x7f99f40c9800 2024-08-31T12:21:46.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.763+0000 7f99eaa00640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 0x7f99d40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.763+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f99e40932e0 con 0x7f99f40c9800 2024-08-31T12:21:46.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.763+0000 7f99f2000640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 0x7f99d40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.763+0000 7f99f2000640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 0x7f99d40745d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f99e00af000 tx=0x7f99e001b060 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.767+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f99e405e6d0 con 0x7f99f40c9800 2024-08-31T12:21:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99f40c4f70 con 0x7f99f40c9800 2024-08-31T12:21:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99eaa00640 1 -- 172.21.15.164:0/1355559330 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+19330 (secure 0 0 0) 0x7f99e405dfd0 con 0x7f99f40c9800 2024-08-31T12:21:46.938 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:46.939 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":56,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:21:16.365692+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6834/4233946054":"2024-09-01T12:21:16.365631+0000","172.21.15.184:6837/4233946054":"2024-09-01T12:21:16.365631+0000","172.21.15.164:6835/580774116":"2024-09-01T12:20:26.356943+0000","172.21.15.164:6834/580774116":"2024-09-01T12:20:26.356943+0000","172.21.15.184:6837/1093030453":"2024-09-01T12:19:21.343788+0000","172.21.15.184:6834/1093030453":"2024-09-01T12:19:21.343788+0000","172.21.15.164:6835/2031819890":"2024-09-01T12:16:31.307712+0000","172.21.15.164:6834/2031819890":"2024-09-01T12:16:31.307712+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:21:46.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 msgr2=0x7f99d40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 0x7f99d40745d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f99e00af000 tx=0x7f99e001b060 comp rx=0 tx=0).stop 2024-08-31T12:21:46.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 msgr2=0x7f99f4159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f99e400d950 tx=0x7f99e400de10 comp rx=0 tx=0).stop 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 shutdown_connections 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f99d40720c0 0x7f99d40745d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99f415c410 0x7f99f40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99f414efb0 0x7f99f415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 --2- 172.21.15.164:0/1355559330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40c9800 0x7f99f4159b40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 >> 172.21.15.164:0/1355559330 conn(0x7f99f4072590 msgr2=0x7f99f40c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 shutdown_connections 2024-08-31T12:21:46.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:46.935+0000 7f99f9800640 1 -- 172.21.15.164:0/1355559330 wait complete. 2024-08-31T12:21:47.961 INFO:tasks.ceph:Scrubbing osd.0 2024-08-31T12:21:47.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:48.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- 172.21.15.164:0/2491637768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc15ced0 msgr2=0x7f00dc15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 --2- 172.21.15.164:0/2491637768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc15ced0 0x7f00dc15d2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009bc0 tx=0x7f00d401cb70 comp rx=0 tx=0).stop 2024-08-31T12:21:48.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- 172.21.15.164:0/2491637768 shutdown_connections 2024-08-31T12:21:48.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 --2- 172.21.15.164:0/2491637768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc15ced0 0x7f00dc15d2e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 --2- 172.21.15.164:0/2491637768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00dc0c4ce0 0x7f00dc1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- 172.21.15.164:0/2491637768 >> 172.21.15.164:0/2491637768 conn(0x7f00dc073630 msgr2=0x7f00dc073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- 172.21.15.164:0/2491637768 shutdown_connections 2024-08-31T12:21:48.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- 172.21.15.164:0/2491637768 wait complete. 2024-08-31T12:21:48.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 Processor -- start 2024-08-31T12:21:48.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.126+0000 7f00e1600640 1 -- start start 2024-08-31T12:21:48.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00dc0c4790 0x7f00dc1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc0c4ce0 0x7f00dc0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 0x7f00dc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc0c3fe0 con 0x7f00dc15ced0 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc153e20 con 0x7f00dc0c4ce0 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f00dc1f6520 con 0x7f00dc0c4790 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 0x7f00dc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 0x7f00dc1526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47332/0 (socket says 172.21.15.164:47332) 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 -- 172.21.15.164:0/639251882 learned_addr learned my addr 172.21.15.164:0/639251882 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00daa00640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00dc0c4790 0x7f00dc1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00d2000640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc0c4ce0 0x7f00dc0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 -- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00dc0c4790 msgr2=0x7f00dc1f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00dc0c4790 0x7f00dc1f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 -- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc0c4ce0 msgr2=0x7f00dc0b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00dc0c4ce0 0x7f00dc0b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc1512b0 con 0x7f00dc15ced0 2024-08-31T12:21:48.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00db400640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 0x7f00dc1526e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009b10 tx=0x7f00d4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d40bb070 con 0x7f00dc15ced0 2024-08-31T12:21:48.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00d4004d40 con 0x7f00dc15ced0 2024-08-31T12:21:48.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b2040 con 0x7f00dc15ced0 2024-08-31T12:21:48.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc151570 con 0x7f00dc15ced0 2024-08-31T12:21:48.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc145f70 con 0x7f00dc15ced0 2024-08-31T12:21:48.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.130+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00dc1538e0 con 0x7f00dc15ced0 2024-08-31T12:21:48.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f00d40be070 con 0x7f00dc15ced0 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f00b80720c0 0x7f00b80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f00d412d610 con 0x7f00dc15ced0 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7f00b807bbb0 0x7f00b807e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00d40a6e50 con 0x7f00b807bbb0 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f00d412d9c0 con 0x7f00dc15ced0 2024-08-31T12:21:48.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00daa00640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f00b80720c0 0x7f00b80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d2000640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7f00b807bbb0 0x7f00b807e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d2000640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7f00b807bbb0 0x7f00b807e080 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00daa00640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f00b80720c0 0x7f00b80745d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0096c0 tx=0x7f00cc009260 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.134+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== osd.0 v2:172.21.15.164:6808/624071425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00d40a6e50 con 0x7f00b807bbb0 2024-08-31T12:21:48.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 --> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f00dc157270 con 0x7f00b807bbb0 2024-08-31T12:21:48.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00d3400640 1 -- 172.21.15.164:0/639251882 <== osd.0 v2:172.21.15.164:6808/624071425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f00dc157270 con 0x7f00b807bbb0 2024-08-31T12:21:48.154 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:48.154 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:48.154 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:48.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7f00b807bbb0 msgr2=0x7f00b807e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:6808/624071425,v1:172.21.15.164:6809/624071425] conn(0x7f00b807bbb0 0x7f00b807e080 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f00b80720c0 msgr2=0x7f00b80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f00b80720c0 0x7f00b80745d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0096c0 tx=0x7f00cc009260 comp rx=0 tx=0).stop 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 msgr2=0x7f00dc1526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 --2- 172.21.15.164:0/639251882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00dc15ced0 0x7f00dc1526e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009b10 tx=0x7f00d4009260 comp rx=0 tx=0).stop 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00db400640 1 -- 172.21.15.164:0/639251882 reap_dead start 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 shutdown_connections 2024-08-31T12:21:48.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 >> 172.21.15.164:0/639251882 conn(0x7f00dc073630 msgr2=0x7f00dc0cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 shutdown_connections 2024-08-31T12:21:48.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.150+0000 7f00e1600640 1 -- 172.21.15.164:0/639251882 wait complete. 2024-08-31T12:21:48.173 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-31T12:21:48.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 -- 172.21.15.164:0/2515426821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeac004d50 msgr2=0x7faeac005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 --2- 172.21.15.164:0/2515426821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeac004d50 0x7faeac005160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faec80c3430 tx=0x7faec001fa00 comp rx=0 tx=0).stop 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecd600640 1 -- 172.21.15.164:0/2515426821 reap_dead start 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 -- 172.21.15.164:0/2515426821 shutdown_connections 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 -- 172.21.15.164:0/2515426821 >> 172.21.15.164:0/2515426821 conn(0x7faec80ccf20 msgr2=0x7faec80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 -- 172.21.15.164:0/2515426821 shutdown_connections 2024-08-31T12:21:48.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.322+0000 7faecf600640 1 -- 172.21.15.164:0/2515426821 wait complete. 2024-08-31T12:21:48.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 Processor -- start 2024-08-31T12:21:48.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 -- start start 2024-08-31T12:21:48.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeac004d50 0x7faec813eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 0x7faec80cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faec8158980 con 0x7faec81f3c20 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faec8158800 con 0x7faeac004d50 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecf600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faec80c8f20 con 0x7faec80cbd20 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47354/0 (socket says 172.21.15.164:47354) 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 -- 172.21.15.164:0/441637190 learned_addr learned my addr 172.21.15.164:0/441637190 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:48.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faeccc00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeac004d50 0x7faec813eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecd600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 0x7faec80cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 -- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 msgr2=0x7faec80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 0x7faec80cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 -- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeac004d50 msgr2=0x7faec813eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeac004d50 0x7faec813eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 -- 172.21.15.164:0/441637190 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80cc760 con 0x7faec81f3c20 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faecd600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 0x7faec80cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:48.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.326+0000 7faebfe00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faeb0011730 tx=0x7faeb0011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004250 con 0x7faec81f3c20 2024-08-31T12:21:48.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb0016070 con 0x7faec81f3c20 2024-08-31T12:21:48.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec81f0740 con 0x7faec81f3c20 2024-08-31T12:21:48.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb000fb40 con 0x7faec81f3c20 2024-08-31T12:21:48.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec81f3420 con 0x7faec81f3c20 2024-08-31T12:21:48.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec80c1f40 con 0x7faec81f3c20 2024-08-31T12:21:48.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.330+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7faeb0018030 con 0x7faec81f3c20 2024-08-31T12:21:48.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.334+0000 7faec5600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 0x7faea40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.334+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7faeb00937c0 con 0x7faec81f3c20 2024-08-31T12:21:48.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.334+0000 7faeccc00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 0x7faea40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.334+0000 7faeccc00640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 0x7faea40745d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009c60 tx=0x7faeb80091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.338+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7faeb005eb10 con 0x7faec81f3c20 2024-08-31T12:21:48.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.502+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7faec80cca90 con 0x7faea40720c0 2024-08-31T12:21:48.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.502+0000 7faec5600640 1 -- 172.21.15.164:0/441637190 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faec80cca90 con 0x7faea40720c0 2024-08-31T12:21:48.508 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 0 to deep-scrub 2024-08-31T12:21:48.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 msgr2=0x7faea40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 0x7faea40745d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009c60 tx=0x7faeb80091e0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 msgr2=0x7faec80cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faeb0011730 tx=0x7faeb0011b30 comp rx=0 tx=0).stop 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 shutdown_connections 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7faea40720c0 0x7faea40745d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faec80cbd20 0x7faec80cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec81f3c20 0x7faec80cb7e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 --2- 172.21.15.164:0/441637190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeac004d50 0x7faec813eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 >> 172.21.15.164:0/441637190 conn(0x7faec80ccf20 msgr2=0x7faec8070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 shutdown_connections 2024-08-31T12:21:48.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.506+0000 7faecf600640 1 -- 172.21.15.164:0/441637190 wait complete. 2024-08-31T12:21:48.531 INFO:tasks.ceph:Scrubbing osd.1 2024-08-31T12:21:48.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- 172.21.15.164:0/2218146374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 msgr2=0x7ff2cc0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2218146374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 0x7ff2cc0c8970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009bc0 tx=0x7ff2c401cac0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- 172.21.15.164:0/2218146374 shutdown_connections 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2218146374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 0x7ff2cc0c8970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2218146374 >> v2:172.21.15.184:3300/0 conn(0x7ff2cc074fb0 0x7ff2cc0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- 172.21.15.164:0/2218146374 >> 172.21.15.164:0/2218146374 conn(0x7ff2cc0ccf20 msgr2=0x7ff2cc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- 172.21.15.164:0/2218146374 shutdown_connections 2024-08-31T12:21:48.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- 172.21.15.164:0/2218146374 wait complete. 2024-08-31T12:21:48.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 Processor -- start 2024-08-31T12:21:48.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.686+0000 7ff2d1200640 1 -- start start 2024-08-31T12:21:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2cc074fb0 0x7ff2cc1f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 0x7ff2cc142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 0x7ff2cc1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc165b30 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc1659b0 con 0x7ff2cc074fb0 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff2cc165cb0 con 0x7ff2cc0c8560 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 0x7ff2cc1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 0x7ff2cc1f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47362/0 (socket says 172.21.15.164:47362) 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 -- 172.21.15.164:0/2722869340 learned_addr learned my addr 172.21.15.164:0/2722869340 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c9e00640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2cc074fb0 0x7ff2cc1f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c9400640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 0x7ff2cc142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 -- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 msgr2=0x7ff2cc142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2cc0c8560 0x7ff2cc142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 -- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2cc074fb0 msgr2=0x7ff2cc1f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2cc074fb0 0x7ff2cc1f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc1f9ba0 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c9e00640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2cc074fb0 0x7ff2cc1f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2ca800640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 0x7ff2cc1f5e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff2c401b170 tx=0x7ff2c4009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40bb070 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc0caf50 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2c4003d70 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40b2040 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc1f8e60 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2cc0c3d80 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.690+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff2c4004cb0 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac0720c0 0x7ff2ac0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7ff2c412d260 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7ff2ac07bb30 0x7ff2ac07e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2ac07e6d0 con 0x7ff2ac07bb30 2024-08-31T12:21:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff2c412d610 con 0x7ff2cc0c94a0 2024-08-31T12:21:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c9e00640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac0720c0 0x7ff2ac0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c9400640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7ff2ac07bb30 0x7ff2ac07e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c9400640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7ff2ac07bb30 0x7ff2ac07e000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c9e00640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac0720c0 0x7ff2ac0745d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009b90 tx=0x7ff2bc0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.694+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== osd.1 v2:172.21.15.164:6816/1467060278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2ac07e6d0 con 0x7ff2ac07bb30 2024-08-31T12:21:48.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.706+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 --> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2cc1f59a0 con 0x7ff2ac07bb30 2024-08-31T12:21:48.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.706+0000 7ff2c2000640 1 -- 172.21.15.164:0/2722869340 <== osd.1 v2:172.21.15.164:6816/1467060278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2cc1f59a0 con 0x7ff2ac07bb30 2024-08-31T12:21:48.713 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:48.713 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:48.713 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:48.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7ff2ac07bb30 msgr2=0x7ff2ac07e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:6816/1467060278,v1:172.21.15.164:6817/1467060278] conn(0x7ff2ac07bb30 0x7ff2ac07e000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac0720c0 msgr2=0x7ff2ac0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2ac0720c0 0x7ff2ac0745d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009b90 tx=0x7ff2bc0091e0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 msgr2=0x7ff2cc1f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 --2- 172.21.15.164:0/2722869340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2cc0c94a0 0x7ff2cc1f5e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff2c401b170 tx=0x7ff2c4009280 comp rx=0 tx=0).stop 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2ca800640 1 -- 172.21.15.164:0/2722869340 reap_dead start 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 shutdown_connections 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 >> 172.21.15.164:0/2722869340 conn(0x7ff2cc0ccf20 msgr2=0x7ff2cc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 shutdown_connections 2024-08-31T12:21:48.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.710+0000 7ff2d1200640 1 -- 172.21.15.164:0/2722869340 wait complete. 2024-08-31T12:21:48.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-31T12:21:48.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- 172.21.15.164:0/1655759955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 msgr2=0x7f0fcc0c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 --2- 172.21.15.164:0/1655759955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c7d30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc072540 tx=0x7f0fc401f580 comp rx=0 tx=0).stop 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- 172.21.15.164:0/1655759955 shutdown_connections 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 --2- 172.21.15.164:0/1655759955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c7d30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 --2- 172.21.15.164:0/1655759955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc0c1f40 0x7f0fcc0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 --2- 172.21.15.164:0/1655759955 >> v2:172.21.15.184:3300/0 conn(0x7f0fcc15bc70 0x7f0fcc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- 172.21.15.164:0/1655759955 >> 172.21.15.164:0/1655759955 conn(0x7f0fcc0ccf20 msgr2=0x7f0fcc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- 172.21.15.164:0/1655759955 shutdown_connections 2024-08-31T12:21:48.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- 172.21.15.164:0/1655759955 wait complete. 2024-08-31T12:21:48.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 Processor -- start 2024-08-31T12:21:48.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.886+0000 7f0fd2800640 1 -- start start 2024-08-31T12:21:48.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc0c1f40 0x7f0fcc1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 0x7f0fcc1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0748a0 con 0x7f0fcc0c7920 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc074720 con 0x7f0fcc0c1f40 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc074a20 con 0x7f0fcc15bc70 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47372/0 (socket says 172.21.15.164:47372) 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 -- 172.21.15.164:0/3788586519 learned_addr learned my addr 172.21.15.164:0/3788586519 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fcb400640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc0c1f40 0x7f0fcc1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fcbe00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 0x7f0fcc1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 -- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 msgr2=0x7f0fcc1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 0x7f0fcc1557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 -- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc0c1f40 msgr2=0x7f0fcc1f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc0c1f40 0x7f0fcc1f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 -- 172.21.15.164:0/3788586519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc0af940 con 0x7f0fcc0c7920 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fcbe00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 0x7f0fcc1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc2a00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d5f0 tx=0x7f0fb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4017070 con 0x7f0fcc0c7920 2024-08-31T12:21:48.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb4009a40 con 0x7f0fcc0c7920 2024-08-31T12:21:48.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4010460 con 0x7f0fcc0c7920 2024-08-31T12:21:48.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc0b0340 con 0x7f0fcc0c7920 2024-08-31T12:21:48.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc0b0e80 con 0x7f0fcc0c7920 2024-08-31T12:21:48.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.890+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc074ea0 con 0x7f0fcc0c7920 2024-08-31T12:21:48.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.894+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0fb401a070 con 0x7f0fcc0c7920 2024-08-31T12:21:48.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.894+0000 7f0fc3e00640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 0x7f0fa80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.894+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f0fb4093070 con 0x7f0fcc0c7920 2024-08-31T12:21:48.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.894+0000 7f0fcb400640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 0x7f0fa80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.894+0000 7f0fcb400640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 0x7f0fa80745d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0058d0 tx=0x7f0fbc005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:48.898+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0fcc0b0340 con 0x7f0fcc0c7920 2024-08-31T12:21:49.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.062+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0fcc0c82f0 con 0x7f0fa80720c0 2024-08-31T12:21:49.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fc3e00640 1 -- 172.21.15.164:0/3788586519 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0fcc0c82f0 con 0x7f0fa80720c0 2024-08-31T12:21:49.069 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 1 to deep-scrub 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 msgr2=0x7f0fa80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 0x7f0fa80745d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0058d0 tx=0x7f0fbc005860 comp rx=0 tx=0).stop 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 msgr2=0x7f0fcc0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d5f0 tx=0x7f0fb400dab0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 shutdown_connections 2024-08-31T12:21:49.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0fa80720c0 0x7f0fa80745d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fcc15bc70 0x7f0fcc1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc0c7920 0x7f0fcc0c6160 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 --2- 172.21.15.164:0/3788586519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc0c1f40 0x7f0fcc1f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 >> 172.21.15.164:0/3788586519 conn(0x7f0fcc0ccf20 msgr2=0x7f0fcc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 shutdown_connections 2024-08-31T12:21:49.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.066+0000 7f0fd2800640 1 -- 172.21.15.164:0/3788586519 wait complete. 2024-08-31T12:21:49.093 INFO:tasks.ceph:Scrubbing osd.2 2024-08-31T12:21:49.094 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:49.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 -- 172.21.15.164:0/1197621785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b68004d50 msgr2=0x7f0b680051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 --2- 172.21.15.164:0/1197621785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b68004d50 0x7f0b680051a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ccd00 tx=0x7f0b7c01cc20 comp rx=0 tx=0).stop 2024-08-31T12:21:49.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b82800640 1 -- 172.21.15.164:0/1197621785 reap_dead start 2024-08-31T12:21:49.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 -- 172.21.15.164:0/1197621785 shutdown_connections 2024-08-31T12:21:49.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 -- 172.21.15.164:0/1197621785 >> 172.21.15.164:0/1197621785 conn(0x7f0b840718c0 msgr2=0x7f0b8406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 -- 172.21.15.164:0/1197621785 shutdown_connections 2024-08-31T12:21:49.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.246+0000 7f0b83200640 1 -- 172.21.15.164:0/1197621785 wait complete. 2024-08-31T12:21:49.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 Processor -- start 2024-08-31T12:21:49.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 -- start start 2024-08-31T12:21:49.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68004d50 0x7f0b841e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 0x7f0b84151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b841580a0 0x7f0b84151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840c61e0 con 0x7f0b84157c90 2024-08-31T12:21:49.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840cd390 con 0x7f0b68004d50 2024-08-31T12:21:49.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b83200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840c5040 con 0x7f0b841580a0 2024-08-31T12:21:49.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b81400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 0x7f0b84151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b81400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 0x7f0b84151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47396/0 (socket says 172.21.15.164:47396) 2024-08-31T12:21:49.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b81400640 1 -- 172.21.15.164:0/4224337616 learned_addr learned my addr 172.21.15.164:0/4224337616 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.250+0000 7f0b81e00640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68004d50 0x7f0b841e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b82800640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b841580a0 0x7f0b84151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 -- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b841580a0 msgr2=0x7f0b84151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b841580a0 0x7f0b84151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 -- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68004d50 msgr2=0x7f0b841e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68004d50 0x7f0b841e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b841e5470 con 0x7f0b84157c90 2024-08-31T12:21:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b81400640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 0x7f0b84151650 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b700116d0 tx=0x7f0b70011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70011ea0 con 0x7f0b84157c90 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b70016070 con 0x7f0b84157c90 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000fba0 con 0x7f0b84157c90 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b841f14f0 con 0x7f0b84157c90 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841f1ab0 con 0x7f0b84157c90 2024-08-31T12:21:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b840ce050 con 0x7f0b84157c90 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.254+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0b70018030 con 0x7f0b84157c90 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0b640720f0 0x7f0b64074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f0b70093710 con 0x7f0b84157c90 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f0b6407bbe0 0x7f0b6407e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b70007e90 con 0x7f0b6407bbe0 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f0b7009a050 con 0x7f0b84157c90 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b81e00640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0b640720f0 0x7f0b64074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b82800640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f0b6407bbe0 0x7f0b6407e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b82800640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f0b6407bbe0 0x7f0b6407e0b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b81e00640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0b640720f0 0x7f0b64074600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b74001250 tx=0x7f0b740011a0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.258+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== osd.2 v2:172.21.15.164:6824/3066810189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b70007e90 con 0x7f0b6407bbe0 2024-08-31T12:21:49.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 --> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b840cabf0 con 0x7f0b6407bbe0 2024-08-31T12:21:49.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b7a000640 1 -- 172.21.15.164:0/4224337616 <== osd.2 v2:172.21.15.164:6824/3066810189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b840cabf0 con 0x7f0b6407bbe0 2024-08-31T12:21:49.276 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:49.277 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f0b6407bbe0 msgr2=0x7f0b6407e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:6824/3066810189,v1:172.21.15.164:6825/3066810189] conn(0x7f0b6407bbe0 0x7f0b6407e0b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0b640720f0 msgr2=0x7f0b64074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f0b640720f0 0x7f0b64074600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b74001250 tx=0x7f0b740011a0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 msgr2=0x7f0b84151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 --2- 172.21.15.164:0/4224337616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b84157c90 0x7f0b84151650 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b700116d0 tx=0x7f0b70011b90 comp rx=0 tx=0).stop 2024-08-31T12:21:49.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b82800640 1 -- 172.21.15.164:0/4224337616 reap_dead start 2024-08-31T12:21:49.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 shutdown_connections 2024-08-31T12:21:49.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.270+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 >> 172.21.15.164:0/4224337616 conn(0x7f0b840718c0 msgr2=0x7f0b840c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.274+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 shutdown_connections 2024-08-31T12:21:49.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.274+0000 7f0b83200640 1 -- 172.21.15.164:0/4224337616 wait complete. 2024-08-31T12:21:49.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- 172.21.15.164:0/232063349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea00c1f40 msgr2=0x7f8ea00c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 --2- 172.21.15.164:0/232063349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea00c1f40 0x7f8ea00c9330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0073250 tx=0x7f8e8801f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- 172.21.15.164:0/232063349 shutdown_connections 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 --2- 172.21.15.164:0/232063349 >> v2:172.21.15.184:3300/0 conn(0x7f8ea00c7920 0x7f8ea00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 --2- 172.21.15.164:0/232063349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea00c1f40 0x7f8ea00c9330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 --2- 172.21.15.164:0/232063349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea015bc70 0x7f8ea0152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- 172.21.15.164:0/232063349 >> 172.21.15.164:0/232063349 conn(0x7f8ea00ccf20 msgr2=0x7f8ea00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- 172.21.15.164:0/232063349 shutdown_connections 2024-08-31T12:21:49.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- 172.21.15.164:0/232063349 wait complete. 2024-08-31T12:21:49.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 Processor -- start 2024-08-31T12:21:49.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.446+0000 7f8ea6000640 1 -- start start 2024-08-31T12:21:49.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea00c1f40 0x7f8ea01f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00c7920 0x7f8ea0153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00710c0 con 0x7f8ea015bc70 2024-08-31T12:21:49.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0070f40 con 0x7f8ea00c7920 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea0071240 con 0x7f8ea00c1f40 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea00c1f40 0x7f8ea01f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47406/0 (socket says 172.21.15.164:47406) 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 -- 172.21.15.164:0/3892908603 learned_addr learned my addr 172.21.15.164:0/3892908603 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e96a00640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00c7920 0x7f8ea0153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 -- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea00c1f40 msgr2=0x7f8ea01f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea00c1f40 0x7f8ea01f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 -- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00c7920 msgr2=0x7f8ea0153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00c7920 0x7f8ea0153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 -- 172.21.15.164:0/3892908603 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea01544d0 con 0x7f8ea015bc70 2024-08-31T12:21:49.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e9fe00640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9c0 tx=0x7f8e9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004d30 con 0x7f8ea015bc70 2024-08-31T12:21:49.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e9800cb20 con 0x7f8ea015bc70 2024-08-31T12:21:49.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98005020 con 0x7f8ea015bc70 2024-08-31T12:21:49.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea0162880 con 0x7f8ea015bc70 2024-08-31T12:21:49.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea0153790 con 0x7f8ea015bc70 2024-08-31T12:21:49.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.450+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00c7d30 con 0x7f8ea015bc70 2024-08-31T12:21:49.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.454+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8e980051c0 con 0x7f8ea015bc70 2024-08-31T12:21:49.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.454+0000 7f8e97e00640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 0x7f8e7c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.454+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f8e98093980 con 0x7f8ea015bc70 2024-08-31T12:21:49.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.454+0000 7f8e9f400640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 0x7f8e7c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.454+0000 7f8e9f400640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 0x7f8e7c0745d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000bb50 tx=0x7f8e9000b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.458+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8e98016030 con 0x7f8ea015bc70 2024-08-31T12:21:49.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.622+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8ea0075210 con 0x7f8e7c0720c0 2024-08-31T12:21:49.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.622+0000 7f8e97e00640 1 -- 172.21.15.164:0/3892908603 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8ea0075210 con 0x7f8e7c0720c0 2024-08-31T12:21:49.628 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 2 to deep-scrub 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 msgr2=0x7f8e7c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 0x7f8e7c0745d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000bb50 tx=0x7f8e9000b2e0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 msgr2=0x7f8ea015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9c0 tx=0x7f8e9800ee80 comp rx=0 tx=0).stop 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 shutdown_connections 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f8e7c0720c0 0x7f8e7c0745d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ea015bc70 0x7f8ea015aa60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00c7920 0x7f8ea0153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 --2- 172.21.15.164:0/3892908603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea00c1f40 0x7f8ea01f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 >> 172.21.15.164:0/3892908603 conn(0x7f8ea00ccf20 msgr2=0x7f8ea00cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 shutdown_connections 2024-08-31T12:21:49.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.626+0000 7f8ea6000640 1 -- 172.21.15.164:0/3892908603 wait complete. 2024-08-31T12:21:49.652 INFO:tasks.ceph:Scrubbing osd.3 2024-08-31T12:21:49.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- 172.21.15.164:0/3575679415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 msgr2=0x7ff4140c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 --2- 172.21.15.164:0/3575679415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 0x7ff4140c4ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4140c3fc0 tx=0x7ff40c01cba0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- 172.21.15.164:0/3575679415 shutdown_connections 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 --2- 172.21.15.164:0/3575679415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 0x7ff4140c4ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 --2- 172.21.15.164:0/3575679415 >> v2:172.21.15.184:3300/0 conn(0x7ff414156c00 0x7ff4140cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- 172.21.15.164:0/3575679415 >> 172.21.15.164:0/3575679415 conn(0x7ff414071a70 msgr2=0x7ff41406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- 172.21.15.164:0/3575679415 shutdown_connections 2024-08-31T12:21:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- 172.21.15.164:0/3575679415 wait complete. 2024-08-31T12:21:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 Processor -- start 2024-08-31T12:21:49.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.806+0000 7ff419600640 1 -- start start 2024-08-31T12:21:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 0x7ff41415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 0x7ff4141f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff414155e90 0x7ff4140ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff4140ccc80 con 0x7ff414156c00 2024-08-31T12:21:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff4140cd950 con 0x7ff414155e90 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff4140ccff0 con 0x7ff4140cbdb0 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 0x7ff4141f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 0x7ff4141f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47420/0 (socket says 172.21.15.164:47420) 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 -- 172.21.15.164:0/2465280469 learned_addr learned my addr 172.21.15.164:0/2465280469 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412a00640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 0x7ff41415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff413400640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff414155e90 0x7ff4140ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 -- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 msgr2=0x7ff41415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4140cbdb0 0x7ff41415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 -- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff414155e90 msgr2=0x7ff4140ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff414155e90 0x7ff4140ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41415ea20 con 0x7ff414156c00 2024-08-31T12:21:49.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff413400640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff414155e90 0x7ff4140ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:21:49.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff412000640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 0x7ff4141f5d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c3f0 tx=0x7ff40000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000052d0 con 0x7ff414156c00 2024-08-31T12:21:49.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff400007020 con 0x7ff414156c00 2024-08-31T12:21:49.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff414159e40 con 0x7ff414156c00 2024-08-31T12:21:49.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400007470 con 0x7ff414156c00 2024-08-31T12:21:49.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff414163790 con 0x7ff414156c00 2024-08-31T12:21:49.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.810+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff414157010 con 0x7ff414156c00 2024-08-31T12:21:49.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff4000067e0 con 0x7ff414156c00 2024-08-31T12:21:49.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff3f40720c0 0x7ff3f40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7ff400092c80 con 0x7ff414156c00 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7ff3f407bbc0 0x7ff3f407e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff400021e50 con 0x7ff3f407bbc0 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff400093110 con 0x7ff414156c00 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff412a00640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff3f40720c0 0x7ff3f40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff413400640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7ff3f407bbc0 0x7ff3f407e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:49.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff413400640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7ff3f407bbc0 0x7ff3f407e090 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff412a00640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff3f40720c0 0x7ff3f40745d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff404009b40 tx=0x7ff404009260 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:49.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.814+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== osd.3 v2:172.21.15.164:6800/2906760086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff400021e50 con 0x7ff3f407bbc0 2024-08-31T12:21:49.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 --> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff4140c7490 con 0x7ff3f407bbc0 2024-08-31T12:21:49.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff40aa00640 1 -- 172.21.15.164:0/2465280469 <== osd.3 v2:172.21.15.164:6800/2906760086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff4140c7490 con 0x7ff3f407bbc0 2024-08-31T12:21:49.836 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:49.836 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:49.836 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7ff3f407bbc0 msgr2=0x7ff3f407e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:6800/2906760086,v1:172.21.15.164:6801/2906760086] conn(0x7ff3f407bbc0 0x7ff3f407e090 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff3f40720c0 msgr2=0x7ff3f40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff3f40720c0 0x7ff3f40745d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff404009b40 tx=0x7ff404009260 comp rx=0 tx=0).stop 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 msgr2=0x7ff4141f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:49.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 --2- 172.21.15.164:0/2465280469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff414156c00 0x7ff4141f5d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c3f0 tx=0x7ff40000c8b0 comp rx=0 tx=0).stop 2024-08-31T12:21:49.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff413400640 1 -- 172.21.15.164:0/2465280469 reap_dead start 2024-08-31T12:21:49.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 shutdown_connections 2024-08-31T12:21:49.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 >> 172.21.15.164:0/2465280469 conn(0x7ff414071a70 msgr2=0x7ff4140cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:49.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 shutdown_connections 2024-08-31T12:21:49.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:49.834+0000 7ff419600640 1 -- 172.21.15.164:0/2465280469 wait complete. 2024-08-31T12:21:49.857 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-31T12:21:50.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 -- 172.21.15.164:0/3622038880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 msgr2=0x7f63a8074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 --2- 172.21.15.164:0/3622038880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8074720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009bc0 tx=0x7f63a001f3b0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 -- 172.21.15.164:0/3622038880 shutdown_connections 2024-08-31T12:21:50.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 --2- 172.21.15.164:0/3622038880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8074720 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 --2- 172.21.15.164:0/3622038880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a815bc70 0x7f63a8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 -- 172.21.15.164:0/3622038880 >> 172.21.15.164:0/3622038880 conn(0x7f63a80ccf20 msgr2=0x7f63a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 -- 172.21.15.164:0/3622038880 shutdown_connections 2024-08-31T12:21:50.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.006+0000 7f63af600640 1 -- 172.21.15.164:0/3622038880 wait complete. 2024-08-31T12:21:50.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 Processor -- start 2024-08-31T12:21:50.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 -- start start 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a80c1f40 0x7f63a80cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80c8030 con 0x7f63a815bc70 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80c3150 con 0x7f63a80c9330 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63af600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f63a8074c60 con 0x7f63a80c1f40 2024-08-31T12:21:50.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47430/0 (socket says 172.21.15.164:47430) 2024-08-31T12:21:50.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 -- 172.21.15.164:0/1269715727 learned_addr learned my addr 172.21.15.164:0/1269715727 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:50.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63acc00640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a80c1f40 0x7f63a80cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63a7e00640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 -- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a80c1f40 msgr2=0x7f63a80cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a80c1f40 0x7f63a80cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 -- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 msgr2=0x7f63a8158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 -- 172.21.15.164:0/1269715727 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a81e2550 con 0x7f63a815bc70 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63ad600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f63a001cfe0 tx=0x7f63a0009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.010+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a00b4040 con 0x7f63a815bc70 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63a00be070 con 0x7f63a815bc70 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a00af8a0 con 0x7f63a815bc70 2024-08-31T12:21:50.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a8156b80 con 0x7f63a815bc70 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a814ba30 con 0x7f63a815bc70 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a81568f0 con 0x7f63a815bc70 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f63a00afa40 con 0x7f63a815bc70 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63a4c00640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 0x7f6388074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f63a01311a0 con 0x7f63a815bc70 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.014+0000 7f63acc00640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 0x7f6388074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.018+0000 7f63acc00640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 0x7f6388074600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f639c0096c0 tx=0x7f639c009260 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.018+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f63a0018f10 con 0x7f63a815bc70 2024-08-31T12:21:50.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.190+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f63a8074720 con 0x7f63880720f0 2024-08-31T12:21:50.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.190+0000 7f63a4c00640 1 -- 172.21.15.164:0/1269715727 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f63a8074720 con 0x7f63880720f0 2024-08-31T12:21:50.195 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 3 to deep-scrub 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 msgr2=0x7f6388074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 0x7f6388074600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f639c0096c0 tx=0x7f639c009260 comp rx=0 tx=0).stop 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 msgr2=0x7f63a814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f63a001cfe0 tx=0x7f63a0009280 comp rx=0 tx=0).stop 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 shutdown_connections 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f63880720f0 0x7f6388074600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63a815bc70 0x7f63a814cb50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63a80c9330 0x7f63a8158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 --2- 172.21.15.164:0/1269715727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63a80c1f40 0x7f63a80cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 >> 172.21.15.164:0/1269715727 conn(0x7f63a80ccf20 msgr2=0x7f63a80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 shutdown_connections 2024-08-31T12:21:50.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.194+0000 7f63af600640 1 -- 172.21.15.164:0/1269715727 wait complete. 2024-08-31T12:21:50.218 INFO:tasks.ceph:Scrubbing osd.4 2024-08-31T12:21:50.218 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 -- 172.21.15.164:0/4004343545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 msgr2=0x7f68a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 --2- 172.21.15.164:0/4004343545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68a8003e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c260 tx=0x7f68b401cf50 comp rx=0 tx=0).stop 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c3400640 1 -- 172.21.15.164:0/4004343545 reap_dead start 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 -- 172.21.15.164:0/4004343545 shutdown_connections 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 -- 172.21.15.164:0/4004343545 >> 172.21.15.164:0/4004343545 conn(0x7f68c40ccf20 msgr2=0x7f68c40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 -- 172.21.15.164:0/4004343545 shutdown_connections 2024-08-31T12:21:50.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.370+0000 7f68c9a00640 1 -- 172.21.15.164:0/4004343545 wait complete. 2024-08-31T12:21:50.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 Processor -- start 2024-08-31T12:21:50.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 -- start start 2024-08-31T12:21:50.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68c415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c41f8500 0x7f68c4153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c4148660 0x7f68c4148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41641a0 con 0x7f68a80039f0 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40717b0 con 0x7f68c4148660 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c9a00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f68c4164320 con 0x7f68c41f8500 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68c415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68c415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47448/0 (socket says 172.21.15.164:47448) 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 -- 172.21.15.164:0/879698176 learned_addr learned my addr 172.21.15.164:0/879698176 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68ba000640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c41f8500 0x7f68c4153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c3400640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c4148660 0x7f68c4148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 -- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c41f8500 msgr2=0x7f68c4153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c41f8500 0x7f68c4153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 -- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c4148660 msgr2=0x7f68c4148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c4148660 0x7f68c4148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.374+0000 7f68c2a00640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41557b0 con 0x7f68a80039f0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68c2a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68c415a1a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006040 tx=0x7f68b4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4001600 con 0x7f68a80039f0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68b40017a0 con 0x7f68a80039f0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c4154f10 con 0x7f68a80039f0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40064c0 con 0x7f68a80039f0 2024-08-31T12:21:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41554d0 con 0x7f68a80039f0 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68c41527d0 con 0x7f68a80039f0 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f68b4003600 con 0x7f68a80039f0 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f68a00720c0 0x7f68a00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f68b412d2b0 con 0x7f68a80039f0 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7f68a007bbb0 0x7f68a007e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b40a7e50 con 0x7f68a007bbb0 2024-08-31T12:21:50.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.378+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f68b412d740 con 0x7f68a80039f0 2024-08-31T12:21:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.382+0000 7f68ba000640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f68a00720c0 0x7f68a00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.382+0000 7f68c3400640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7f68a007bbb0 0x7f68a007e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.382+0000 7f68ba000640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f68a00720c0 0x7f68a00745d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68c40b25f0 tx=0x7f68ac006b20 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.382+0000 7f68c3400640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7f68a007bbb0 0x7f68a007e080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.382+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== osd.4 v2:172.21.15.184:6800/4127972505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68b40a7e50 con 0x7f68a007bbb0 2024-08-31T12:21:50.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 --> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68c4070950 con 0x7f68a007bbb0 2024-08-31T12:21:50.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68bb400640 1 -- 172.21.15.164:0/879698176 <== osd.4 v2:172.21.15.184:6800/4127972505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68c4070950 con 0x7f68a007bbb0 2024-08-31T12:21:50.402 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:50.402 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:50.403 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7f68a007bbb0 msgr2=0x7f68a007e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6800/4127972505,v1:172.21.15.184:6801/4127972505] conn(0x7f68a007bbb0 0x7f68a007e080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f68a00720c0 msgr2=0x7f68a00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f68a00720c0 0x7f68a00745d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68c40b25f0 tx=0x7f68ac006b20 comp rx=0 tx=0).stop 2024-08-31T12:21:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 msgr2=0x7f68c415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 --2- 172.21.15.164:0/879698176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68a80039f0 0x7f68c415a1a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006040 tx=0x7f68b4001cc0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c3400640 1 -- 172.21.15.164:0/879698176 reap_dead start 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 shutdown_connections 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 >> 172.21.15.164:0/879698176 conn(0x7f68c40ccf20 msgr2=0x7f68c4157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 shutdown_connections 2024-08-31T12:21:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.398+0000 7f68c9a00640 1 -- 172.21.15.164:0/879698176 wait complete. 2024-08-31T12:21:50.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-31T12:21:50.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 -- 172.21.15.164:0/1858441993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 msgr2=0x7fe148074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 --2- 172.21.15.164:0/1858441993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe148074720 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe148072540 tx=0x7fe14001f580 comp rx=0 tx=0).stop 2024-08-31T12:21:50.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 -- 172.21.15.164:0/1858441993 shutdown_connections 2024-08-31T12:21:50.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 --2- 172.21.15.164:0/1858441993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe148074720 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 --2- 172.21.15.164:0/1858441993 >> v2:172.21.15.184:3300/0 conn(0x7fe14815bc70 0x7fe148152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.570+0000 7fe14f200640 1 -- 172.21.15.164:0/1858441993 >> 172.21.15.164:0/1858441993 conn(0x7fe1480ccf20 msgr2=0x7fe1480cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- 172.21.15.164:0/1858441993 shutdown_connections 2024-08-31T12:21:50.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- 172.21.15.164:0/1858441993 wait complete. 2024-08-31T12:21:50.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 Processor -- start 2024-08-31T12:21:50.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- start start 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1480c1f40 0x7fe14814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe14815bc70 0x7fe1481555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1480c8030 con 0x7fe1480c9330 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1480c3150 con 0x7fe1480c1f40 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe14f200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe148074c60 con 0x7fe14815bc70 2024-08-31T12:21:50.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.574+0000 7fe13f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47462/0 (socket says 172.21.15.164:47462) 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 -- 172.21.15.164:0/3845242747 learned_addr learned my addr 172.21.15.164:0/3845242747 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe147e00640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1480c1f40 0x7fe14814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe14d200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe14815bc70 0x7fe1481555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 -- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe14815bc70 msgr2=0x7fe1481555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe14815bc70 0x7fe1481555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 -- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1480c1f40 msgr2=0x7fe14814ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1480c1f40 0x7fe14814ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 -- 172.21.15.164:0/3845242747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148071d80 con 0x7fe1480c9330 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe13f400640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe13000b410 tx=0x7fe13000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130015030 con 0x7fe1480c9330 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe130004020 con 0x7fe1480c9330 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1480c6f60 con 0x7fe1480c9330 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300044b0 con 0x7fe1480c9330 2024-08-31T12:21:50.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14814f320 con 0x7fe1480c9330 2024-08-31T12:21:50.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe148074720 con 0x7fe1480c9330 2024-08-31T12:21:50.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.578+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe130018070 con 0x7fe1480c9330 2024-08-31T12:21:50.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.582+0000 7fe144c00640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 0x7fe124074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.582+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fe130092ae0 con 0x7fe1480c9330 2024-08-31T12:21:50.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.582+0000 7fe147e00640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 0x7fe124074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.582+0000 7fe147e00640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 0x7fe124074600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe138004630 tx=0x7fe13800b2e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.586+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe13005d870 con 0x7fe1480c9330 2024-08-31T12:21:50.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.754+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe1480699c0 con 0x7fe1240720f0 2024-08-31T12:21:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.754+0000 7fe144c00640 1 -- 172.21.15.164:0/3845242747 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1480699c0 con 0x7fe1240720f0 2024-08-31T12:21:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 4 to deep-scrub 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 msgr2=0x7fe124074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 0x7fe124074600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe138004630 tx=0x7fe13800b2e0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 msgr2=0x7fe1480c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe13000b410 tx=0x7fe13000b8d0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 shutdown_connections 2024-08-31T12:21:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe1240720f0 0x7fe124074600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe14815bc70 0x7fe1481555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1480c9330 0x7fe1480c6a20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 --2- 172.21.15.164:0/3845242747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1480c1f40 0x7fe14814ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 >> 172.21.15.164:0/3845242747 conn(0x7fe1480ccf20 msgr2=0x7fe1480c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 shutdown_connections 2024-08-31T12:21:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.758+0000 7fe14f200640 1 -- 172.21.15.164:0/3845242747 wait complete. 2024-08-31T12:21:50.784 INFO:tasks.ceph:Scrubbing osd.5 2024-08-31T12:21:50.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:50.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 -- 172.21.15.164:0/507963607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 msgr2=0x7f234014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 --2- 172.21.15.164:0/507963607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014e4f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f234006f550 tx=0x7f233001f090 comp rx=0 tx=0).stop 2024-08-31T12:21:50.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 -- 172.21.15.164:0/507963607 shutdown_connections 2024-08-31T12:21:50.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 --2- 172.21.15.164:0/507963607 >> v2:172.21.15.184:3300/0 conn(0x7f234006fe20 0x7f2340070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 --2- 172.21.15.164:0/507963607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014e4f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 -- 172.21.15.164:0/507963607 >> 172.21.15.164:0/507963607 conn(0x7f23400ccf20 msgr2=0x7f23400cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 -- 172.21.15.164:0/507963607 shutdown_connections 2024-08-31T12:21:50.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.942+0000 7f2345c00640 1 -- 172.21.15.164:0/507963607 wait complete. 2024-08-31T12:21:50.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 Processor -- start 2024-08-31T12:21:50.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- start start 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f234006fe20 0x7f23401513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2340071520 0x7f234014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2340070230 con 0x7f23400c3060 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f234006f900 con 0x7f234006fe20 2024-08-31T12:21:50.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2340074830 con 0x7f2340071520 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47476/0 (socket says 172.21.15.164:47476) 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 -- 172.21.15.164:0/2426953610 learned_addr learned my addr 172.21.15.164:0/2426953610 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233ea00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f234006fe20 0x7f23401513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233e000640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2340071520 0x7f234014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 -- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2340071520 msgr2=0x7f234014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2340071520 0x7f234014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 -- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f234006fe20 msgr2=0x7f23401513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f234006fe20 0x7f23401513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400c72a0 con 0x7f23400c3060 2024-08-31T12:21:50.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f233f400640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014eb00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f233800c710 tx=0x7f233800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338003b80 con 0x7f23400c3060 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2338003d20 con 0x7f23400c3060 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23401507d0 con 0x7f23400c3060 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233800aab0 con 0x7f23400c3060 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.946+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400c6480 con 0x7f23400c3060 2024-08-31T12:21:50.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2340074290 con 0x7f23400c3060 2024-08-31T12:21:50.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f233800ac50 con 0x7f23400c3060 2024-08-31T12:21:50.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23200720f0 0x7f2320074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f23380936c0 con 0x7f23400c3060 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f232007bbe0 0x7f232007e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f233801de70 con 0x7f232007bbe0 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f2338093b20 con 0x7f23400c3060 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f233ea00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23200720f0 0x7f2320074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.950+0000 7f233e000640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f232007bbe0 0x7f232007e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:50.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.954+0000 7f233ea00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23200720f0 0x7f2320074600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f23300b2000 tx=0x7f233001d8d0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.954+0000 7f233e000640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f232007bbe0 0x7f232007e0b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:50.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.954+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== osd.5 v2:172.21.15.184:6810/3751959683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f233801de70 con 0x7f232007bbe0 2024-08-31T12:21:50.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.966+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 --> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f234014f7a0 con 0x7f232007bbe0 2024-08-31T12:21:50.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2336a00640 1 -- 172.21.15.164:0/2426953610 <== osd.5 v2:172.21.15.184:6810/3751959683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f234014f7a0 con 0x7f232007bbe0 2024-08-31T12:21:50.973 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:50.973 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:50.973 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:50.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f232007bbe0 msgr2=0x7f232007e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6810/3751959683,v1:172.21.15.184:6811/3751959683] conn(0x7f232007bbe0 0x7f232007e0b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23200720f0 msgr2=0x7f2320074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f23200720f0 0x7f2320074600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f23300b2000 tx=0x7f233001d8d0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 msgr2=0x7f234014eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 --2- 172.21.15.164:0/2426953610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23400c3060 0x7f234014eb00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f233800c710 tx=0x7f233800cbd0 comp rx=0 tx=0).stop 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f233f400640 1 -- 172.21.15.164:0/2426953610 reap_dead start 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 shutdown_connections 2024-08-31T12:21:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 >> 172.21.15.164:0/2426953610 conn(0x7f23400ccf20 msgr2=0x7f2340155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:50.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 shutdown_connections 2024-08-31T12:21:50.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:50.970+0000 7f2345c00640 1 -- 172.21.15.164:0/2426953610 wait complete. 2024-08-31T12:21:50.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-31T12:21:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 -- 172.21.15.164:0/684910727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 msgr2=0x7ff27c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 --2- 172.21.15.164:0/684910727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff27c004c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff29415cd90 tx=0x7ff28001f590 comp rx=0 tx=0).stop 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29a200640 1 -- 172.21.15.164:0/684910727 reap_dead start 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 -- 172.21.15.164:0/684910727 shutdown_connections 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 -- 172.21.15.164:0/684910727 >> 172.21.15.164:0/684910727 conn(0x7ff2940ccf20 msgr2=0x7ff2940cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 -- 172.21.15.164:0/684910727 shutdown_connections 2024-08-31T12:21:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.142+0000 7ff29c200640 1 -- 172.21.15.164:0/684910727 wait complete. 2024-08-31T12:21:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 Processor -- start 2024-08-31T12:21:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 -- start start 2024-08-31T12:21:51.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff29414fe60 0x7ff2940afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2940aeaa0 0x7ff2941f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940c8030 con 0x7ff27c004810 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940c3150 con 0x7ff2940aeaa0 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29c200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff294074e30 con 0x7ff29414fe60 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47484/0 (socket says 172.21.15.164:47484) 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 -- 172.21.15.164:0/1608941027 learned_addr learned my addr 172.21.15.164:0/1608941027 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff29a200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2940aeaa0 0x7ff2941f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff298e00640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff29414fe60 0x7ff2940afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 -- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff29414fe60 msgr2=0x7ff2940afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff29414fe60 0x7ff2940afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 -- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2940aeaa0 msgr2=0x7ff2941f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2940aeaa0 0x7ff2941f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.146+0000 7ff299800640 1 -- 172.21.15.164:0/1608941027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff294151080 con 0x7ff27c004810 2024-08-31T12:21:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff299800640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2880119b0 tx=0x7ff288011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28800fcf0 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff288004030 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff294153800 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288004460 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff294153da0 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff294153fe0 con 0x7ff27c004810 2024-08-31T12:21:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff288003600 con 0x7ff27c004810 2024-08-31T12:21:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 0x7ff2740745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7ff288093ea0 con 0x7ff27c004810 2024-08-31T12:21:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.150+0000 7ff298e00640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 0x7ff2740745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.154+0000 7ff298e00640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 0x7ff2740745d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2800b0000 tx=0x7ff2800b3040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.154+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff28805f1f0 con 0x7ff27c004810 2024-08-31T12:21:51.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.322+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff294152a10 con 0x7ff2740720c0 2024-08-31T12:21:51.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.322+0000 7ff291600640 1 -- 172.21.15.164:0/1608941027 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff294152a10 con 0x7ff2740720c0 2024-08-31T12:21:51.328 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 5 to deep-scrub 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 msgr2=0x7ff2740745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 0x7ff2740745d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2800b0000 tx=0x7ff2800b3040 comp rx=0 tx=0).stop 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 msgr2=0x7ff2941f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2880119b0 tx=0x7ff288011e70 comp rx=0 tx=0).stop 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 shutdown_connections 2024-08-31T12:21:51.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7ff2740720c0 0x7ff2740745d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2940aeaa0 0x7ff2941f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff29414fe60 0x7ff2940afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 --2- 172.21.15.164:0/1608941027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff27c004810 0x7ff2941f5990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 >> 172.21.15.164:0/1608941027 conn(0x7ff2940ccf20 msgr2=0x7ff294150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 shutdown_connections 2024-08-31T12:21:51.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.326+0000 7ff29c200640 1 -- 172.21.15.164:0/1608941027 wait complete. 2024-08-31T12:21:51.350 INFO:tasks.ceph:Scrubbing osd.6 2024-08-31T12:21:51.351 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:51.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- 172.21.15.164:0/3174096772 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda48003a10 msgr2=0x7fda48003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 --2- 172.21.15.164:0/3174096772 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda48003a10 0x7fda48003e80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fda5400c470 tx=0x7fda5401f790 comp rx=0 tx=0).stop 2024-08-31T12:21:51.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda62800640 1 -- 172.21.15.164:0/3174096772 reap_dead start 2024-08-31T12:21:51.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- 172.21.15.164:0/3174096772 shutdown_connections 2024-08-31T12:21:51.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- 172.21.15.164:0/3174096772 >> 172.21.15.164:0/3174096772 conn(0x7fda64072460 msgr2=0x7fda64072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- 172.21.15.164:0/3174096772 shutdown_connections 2024-08-31T12:21:51.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- 172.21.15.164:0/3174096772 wait complete. 2024-08-31T12:21:51.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 Processor -- start 2024-08-31T12:21:51.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.506+0000 7fda63200640 1 -- start start 2024-08-31T12:21:51.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda48003a10 0x7fda640cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda641e61f0 0x7fda641e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 0x7fda641494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fda640c7f20 con 0x7fda6414e040 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fda640c9410 con 0x7fda48003a10 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fda640c80a0 con 0x7fda641e61f0 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 0x7fda641494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 0x7fda641494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47508/0 (socket says 172.21.15.164:47508) 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 -- 172.21.15.164:0/1613179173 learned_addr learned my addr 172.21.15.164:0/1613179173 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda61e00640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda48003a10 0x7fda640cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda59400640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda641e61f0 0x7fda641e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 -- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda641e61f0 msgr2=0x7fda641e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda641e61f0 0x7fda641e7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 -- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda48003a10 msgr2=0x7fda640cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda48003a10 0x7fda640cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda641e7870 con 0x7fda6414e040 2024-08-31T12:21:51.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda62800640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 0x7fda641494e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fda5c011b20 tx=0x7fda5c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c003980 con 0x7fda6414e040 2024-08-31T12:21:51.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda5c003b20 con 0x7fda6414e040 2024-08-31T12:21:51.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c004030 con 0x7fda6414e040 2024-08-31T12:21:51.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6414da70 con 0x7fda6414e040 2024-08-31T12:21:51.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda641f1a10 con 0x7fda6414e040 2024-08-31T12:21:51.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.510+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda64153950 con 0x7fda6414e040 2024-08-31T12:21:51.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fda5c0041d0 con 0x7fda6414e040 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda400720c0 0x7fda400745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fda5c094120 con 0x7fda6414e040 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7fda4007bbb0 0x7fda4007e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda5c01ce50 con 0x7fda4007bbb0 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fda5c09b050 con 0x7fda6414e040 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda61e00640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda400720c0 0x7fda400745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda59400640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7fda4007bbb0 0x7fda4007e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda61e00640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda400720c0 0x7fda400745d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda5400c470 tx=0x7fda5401c5d0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.514+0000 7fda59400640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7fda4007bbb0 0x7fda4007e080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.522+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== osd.6 v2:172.21.15.184:6826/1165040551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda5c01ce50 con 0x7fda4007bbb0 2024-08-31T12:21:51.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 --> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda640c7a10 con 0x7fda4007bbb0 2024-08-31T12:21:51.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda5aa00640 1 -- 172.21.15.164:0/1613179173 <== osd.6 v2:172.21.15.184:6826/1165040551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda640c7a10 con 0x7fda4007bbb0 2024-08-31T12:21:51.535 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:51.535 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:51.535 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:51.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7fda4007bbb0 msgr2=0x7fda4007e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6826/1165040551,v1:172.21.15.184:6827/1165040551] conn(0x7fda4007bbb0 0x7fda4007e080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda400720c0 msgr2=0x7fda400745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fda400720c0 0x7fda400745d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda5400c470 tx=0x7fda5401c5d0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 msgr2=0x7fda641494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 --2- 172.21.15.164:0/1613179173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda6414e040 0x7fda641494e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fda5c011b20 tx=0x7fda5c00f3c0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda62800640 1 -- 172.21.15.164:0/1613179173 reap_dead start 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 shutdown_connections 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 >> 172.21.15.164:0/1613179173 conn(0x7fda64072460 msgr2=0x7fda640c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 shutdown_connections 2024-08-31T12:21:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.530+0000 7fda63200640 1 -- 172.21.15.164:0/1613179173 wait complete. 2024-08-31T12:21:51.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-31T12:21:51.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- 172.21.15.164:0/4133178102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a815bc70 msgr2=0x7fc7a8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 --2- 172.21.15.164:0/4133178102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a815bc70 0x7fc7a8152a10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8070b70 tx=0x7fc79801f0b0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- 172.21.15.164:0/4133178102 shutdown_connections 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 --2- 172.21.15.164:0/4133178102 >> v2:172.21.15.184:3300/0 conn(0x7fc7a80c1f40 0x7fc7a80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 --2- 172.21.15.164:0/4133178102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a815bc70 0x7fc7a8152a10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- 172.21.15.164:0/4133178102 >> 172.21.15.164:0/4133178102 conn(0x7fc7a80ccf20 msgr2=0x7fc7a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- 172.21.15.164:0/4133178102 shutdown_connections 2024-08-31T12:21:51.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- 172.21.15.164:0/4133178102 wait complete. 2024-08-31T12:21:51.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 Processor -- start 2024-08-31T12:21:51.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.706+0000 7fc7ae600640 1 -- start start 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 0x7fc7a81f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 0x7fc7a80af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8074fb0 con 0x7fc7a80c1f40 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8074e30 con 0x7fc7a80c7920 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80c7d30 con 0x7fc7a815bc70 2024-08-31T12:21:51.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47530/0 (socket says 172.21.15.164:47530) 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 -- 172.21.15.164:0/2398924089 learned_addr learned my addr 172.21.15.164:0/2398924089 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7e00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 0x7fc7a80af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc79ea00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 0x7fc7a81f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 -- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 msgr2=0x7fc7a80af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 0x7fc7a80af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 -- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 msgr2=0x7fc7a81f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 0x7fc7a81f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 -- 172.21.15.164:0/2398924089 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a81536b0 con 0x7fc7a80c1f40 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7e00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 0x7fc7a80af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc79ea00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 0x7fc7a81f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7a7400640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b3040 tx=0x7fc798005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980b5040 con 0x7fc7a80c1f40 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc798005320 con 0x7fc7a80c1f40 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a81558b0 con 0x7fc7a80c1f40 2024-08-31T12:21:51.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980046d0 con 0x7fc7a80c1f40 2024-08-31T12:21:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a81f60f0 con 0x7fc7a80c1f40 2024-08-31T12:21:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.710+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a80c9330 con 0x7fc7a80c1f40 2024-08-31T12:21:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.714+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc7980c0060 con 0x7fc7a80c1f40 2024-08-31T12:21:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.714+0000 7fc79fe00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 0x7fc7840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.714+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fc798130080 con 0x7fc7a80c1f40 2024-08-31T12:21:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.714+0000 7fc79ea00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 0x7fc7840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.714+0000 7fc79ea00640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 0x7fc7840745d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc790005fd0 tx=0x7fc790005de0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:51.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.718+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc798018c10 con 0x7fc7a80c1f40 2024-08-31T12:21:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.886+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc7a80c82f0 con 0x7fc7840720c0 2024-08-31T12:21:51.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.886+0000 7fc79fe00640 1 -- 172.21.15.164:0/2398924089 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc7a80c82f0 con 0x7fc7840720c0 2024-08-31T12:21:51.892 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 6 to deep-scrub 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 msgr2=0x7fc7840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 0x7fc7840745d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc790005fd0 tx=0x7fc790005de0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 msgr2=0x7fc7a8155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b3040 tx=0x7fc798005780 comp rx=0 tx=0).stop 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 shutdown_connections 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc7840720c0 0x7fc7840745d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a815bc70 0x7fc7a80af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80c7920 0x7fc7a81f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 --2- 172.21.15.164:0/2398924089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7a80c1f40 0x7fc7a8155370 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:51.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 >> 172.21.15.164:0/2398924089 conn(0x7fc7a80ccf20 msgr2=0x7fc7a8150660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:51.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 shutdown_connections 2024-08-31T12:21:51.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:51.890+0000 7fc7ae600640 1 -- 172.21.15.164:0/2398924089 wait complete. 2024-08-31T12:21:51.915 INFO:tasks.ceph:Scrubbing osd.7 2024-08-31T12:21:51.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-31T12:21:52.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 -- 172.21.15.164:0/1516370170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe73c005e60 msgr2=0x7fe73c006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 --2- 172.21.15.164:0/1516370170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe73c005e60 0x7fe73c006290 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe7580c75b0 tx=0x7fe75001cba0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe756800640 1 -- 172.21.15.164:0/1516370170 reap_dead start 2024-08-31T12:21:52.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 -- 172.21.15.164:0/1516370170 shutdown_connections 2024-08-31T12:21:52.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 -- 172.21.15.164:0/1516370170 >> 172.21.15.164:0/1516370170 conn(0x7fe7580ccf20 msgr2=0x7fe7580cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 -- 172.21.15.164:0/1516370170 shutdown_connections 2024-08-31T12:21:52.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.074+0000 7fe75d000640 1 -- 172.21.15.164:0/1516370170 wait complete. 2024-08-31T12:21:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 Processor -- start 2024-08-31T12:21:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- start start 2024-08-31T12:21:52.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c005e60 0x7fe7580afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7581e8bd0 0x7fe75814d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 0x7fe758152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe758070a50 con 0x7fe75814dda0 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580c2fb0 con 0x7fe73c005e60 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe75806fae0 con 0x7fe7581e8bd0 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 0x7fe758152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 0x7fe758152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47534/0 (socket says 172.21.15.164:47534) 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 -- 172.21.15.164:0/2773073130 learned_addr learned my addr 172.21.15.164:0/2773073130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe74d400640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7581e8bd0 0x7fe75814d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe755e00640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c005e60 0x7fe7580afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 -- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7581e8bd0 msgr2=0x7fe75814d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7581e8bd0 0x7fe75814d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 -- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c005e60 msgr2=0x7fe7580afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c005e60 0x7fe7580afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75814e1b0 con 0x7fe75814dda0 2024-08-31T12:21:52.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe756800640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 0x7fe758152e20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe75001c610 tx=0x7fe750006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750001ab0 con 0x7fe75814dda0 2024-08-31T12:21:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7500a5cb0 con 0x7fe75814dda0 2024-08-31T12:21:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750006c50 con 0x7fe75814dda0 2024-08-31T12:21:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7580b0140 con 0x7fe75814dda0 2024-08-31T12:21:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7581f2600 con 0x7fe75814dda0 2024-08-31T12:21:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.078+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7580703f0 con 0x7fe75814dda0 2024-08-31T12:21:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe750006290 con 0x7fe75814dda0 2024-08-31T12:21:52.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe7340720c0 0x7fe7340745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fe75012ce30 con 0x7fe75814dda0 2024-08-31T12:21:52.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe755e00640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe7340720c0 0x7fe7340745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7fe73407bbb0 0x7fe73407e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7500b2ec0 con 0x7fe73407bbb0 2024-08-31T12:21:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fe75012d1e0 con 0x7fe75814dda0 2024-08-31T12:21:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.082+0000 7fe74d400640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7fe73407bbb0 0x7fe73407e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.086+0000 7fe755e00640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe7340720c0 0x7fe7340745d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe748001270 tx=0x7fe748006040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.086+0000 7fe74d400640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7fe73407bbb0 0x7fe73407e080 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.086+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== osd.7 v2:172.21.15.184:6818/3185978825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7500b2ec0 con 0x7fe73407bbb0 2024-08-31T12:21:52.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.098+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 --> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7581f23b0 con 0x7fe73407bbb0 2024-08-31T12:21:52.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe74ea00640 1 -- 172.21.15.164:0/2773073130 <== osd.7 v2:172.21.15.184:6818/3185978825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7581f23b0 con 0x7fe73407bbb0 2024-08-31T12:21:52.101 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-08-31T12:21:52.101 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T12:21:52.102 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7fe73407bbb0 msgr2=0x7fe73407e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6818/3185978825,v1:172.21.15.184:6819/3185978825] conn(0x7fe73407bbb0 0x7fe73407e080 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe7340720c0 msgr2=0x7fe7340745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fe7340720c0 0x7fe7340745d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe748001270 tx=0x7fe748006040 comp rx=0 tx=0).stop 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 msgr2=0x7fe758152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 --2- 172.21.15.164:0/2773073130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe75814dda0 0x7fe758152e20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe75001c610 tx=0x7fe750006e20 comp rx=0 tx=0).stop 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe756800640 1 -- 172.21.15.164:0/2773073130 reap_dead start 2024-08-31T12:21:52.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 shutdown_connections 2024-08-31T12:21:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 >> 172.21.15.164:0/2773073130 conn(0x7fe7580ccf20 msgr2=0x7fe758156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 shutdown_connections 2024-08-31T12:21:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.102+0000 7fe75d000640 1 -- 172.21.15.164:0/2773073130 wait complete. 2024-08-31T12:21:52.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-31T12:21:52.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 -- 172.21.15.164:0/1701336210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f215015bc70 msgr2=0x7f2150152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 --2- 172.21.15.164:0/1701336210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f215015bc70 0x7f2150152a10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f21500c9020 tx=0x7f214001f0d0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 -- 172.21.15.164:0/1701336210 shutdown_connections 2024-08-31T12:21:52.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 --2- 172.21.15.164:0/1701336210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c1f40 0x7f21500c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 --2- 172.21.15.164:0/1701336210 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f215015bc70 0x7f2150152a10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 -- 172.21.15.164:0/1701336210 >> 172.21.15.164:0/1701336210 conn(0x7f21500ccf20 msgr2=0x7f21500cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 -- 172.21.15.164:0/1701336210 shutdown_connections 2024-08-31T12:21:52.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.274+0000 7f2154e00640 1 -- 172.21.15.164:0/1701336210 wait complete. 2024-08-31T12:21:52.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 Processor -- start 2024-08-31T12:21:52.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 -- start start 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 0x7f21501e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f215015bc70 0x7f215015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2150074fb0 con 0x7f21500c1f40 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2150074e30 con 0x7f215015bc70 2024-08-31T12:21:52.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f2154e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f21500c7d30 con 0x7f21500c7920 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f214de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f214de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47548/0 (socket says 172.21.15.164:47548) 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f214de00640 1 -- 172.21.15.164:0/3825998813 learned_addr learned my addr 172.21.15.164:0/3825998813 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.278+0000 7f214e800640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f215015bc70 0x7f215015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2145400640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 0x7f21501e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 -- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 msgr2=0x7f21501e1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 0x7f21501e1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 -- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f215015bc70 msgr2=0x7f215015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f215015bc70 0x7f215015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 -- 172.21.15.164:0/3825998813 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21501598e0 con 0x7f21500c1f40 2024-08-31T12:21:52.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2145400640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 0x7f21501e1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:52.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f214de00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214001cd00 tx=0x7f2140005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21400be070 con 0x7f21500c1f40 2024-08-31T12:21:52.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21400036f0 con 0x7f21500c1f40 2024-08-31T12:21:52.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21501e6df0 con 0x7f21500c1f40 2024-08-31T12:21:52.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21400b5040 con 0x7f21500c1f40 2024-08-31T12:21:52.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2150159e60 con 0x7f21500c1f40 2024-08-31T12:21:52.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21500c9330 con 0x7f21500c1f40 2024-08-31T12:21:52.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.282+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f21400c1070 con 0x7f21500c1f40 2024-08-31T12:21:52.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.286+0000 7f2146a00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 0x7f212c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.286+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f214012fe80 con 0x7f21500c1f40 2024-08-31T12:21:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.286+0000 7f2145400640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 0x7f212c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.286+0000 7f2145400640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 0x7f212c0745d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21501efb00 tx=0x7f21380091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.290+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2140018c30 con 0x7f21500c1f40 2024-08-31T12:21:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.454+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f21501560a0 con 0x7f212c0720c0 2024-08-31T12:21:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.454+0000 7f2146a00640 1 -- 172.21.15.164:0/3825998813 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f21501560a0 con 0x7f212c0720c0 2024-08-31T12:21:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 7 to deep-scrub 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 msgr2=0x7f212c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 0x7f212c0745d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21501efb00 tx=0x7f21380091e0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 msgr2=0x7f21501e67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214001cd00 tx=0x7f2140005780 comp rx=0 tx=0).stop 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 shutdown_connections 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f212c0720c0 0x7f212c0745d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f215015bc70 0x7f215015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21500c7920 0x7f21501e1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 --2- 172.21.15.164:0/3825998813 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21500c1f40 0x7f21501e67d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 >> 172.21.15.164:0/3825998813 conn(0x7f21500ccf20 msgr2=0x7f215014fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 shutdown_connections 2024-08-31T12:21:52.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.458+0000 7f2154e00640 1 -- 172.21.15.164:0/3825998813 wait complete. 2024-08-31T12:21:52.479 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:21:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 -- 172.21.15.164:0/3773296518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700ceab0 msgr2=0x7fee70152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 --2- 172.21.15.164:0/3773296518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700ceab0 0x7fee70152470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee700c44d0 tx=0x7fee6001c7d0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 -- 172.21.15.164:0/3773296518 shutdown_connections 2024-08-31T12:21:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 --2- 172.21.15.164:0/3773296518 >> v2:172.21.15.184:3300/0 conn(0x7fee700c88c0 0x7fee701529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 --2- 172.21.15.164:0/3773296518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700ceab0 0x7fee70152470 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 -- 172.21.15.164:0/3773296518 >> 172.21.15.164:0/3773296518 conn(0x7fee7006e340 msgr2=0x7fee700cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.634+0000 7fee75200640 1 -- 172.21.15.164:0/3773296518 shutdown_connections 2024-08-31T12:21:52.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 -- 172.21.15.164:0/3773296518 wait complete. 2024-08-31T12:21:52.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 Processor -- start 2024-08-31T12:21:52.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 -- start start 2024-08-31T12:21:52.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee700ceab0 0x7fee70153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 0x7fee700cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fee70165120 con 0x7fee700c88c0 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fee70164fa0 con 0x7fee700ceab0 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee75200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fee701652a0 con 0x7fee7015bd00 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.638+0000 7fee6de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47576/0 (socket says 172.21.15.164:47576) 2024-08-31T12:21:52.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 -- 172.21.15.164:0/4099822139 learned_addr learned my addr 172.21.15.164:0/4099822139 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee65400640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee700ceab0 0x7fee70153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6e800640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 0x7fee700cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 -- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 msgr2=0x7fee700cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 0x7fee700cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 -- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee700ceab0 msgr2=0x7fee70153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee700ceab0 0x7fee70153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 -- 172.21.15.164:0/4099822139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70153f80 con 0x7fee700c88c0 2024-08-31T12:21:52.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6e800640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 0x7fee700cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee6de00640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fee60009790 tx=0x7fee60004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600bb070 con 0x7fee700c88c0 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee60005030 con 0x7fee700c88c0 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee700c7ae0 con 0x7fee700c88c0 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600b2040 con 0x7fee700c88c0 2024-08-31T12:21:52.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee70153240 con 0x7fee700c88c0 2024-08-31T12:21:52.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee700c8000 con 0x7fee700c88c0 2024-08-31T12:21:52.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.642+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fee600be070 con 0x7fee700c88c0 2024-08-31T12:21:52.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.646+0000 7fee66a00640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 0x7fee4c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:52.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.646+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fee6012ccb0 con 0x7fee700c88c0 2024-08-31T12:21:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.646+0000 7fee65400640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 0x7fee4c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:52.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.646+0000 7fee65400640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 0x7fee4c074600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee580058d0 tx=0x7fee58005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:52.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.650+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fee700c8000 con 0x7fee700c88c0 2024-08-31T12:21:52.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.814+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee70153080 con 0x7fee4c0720f0 2024-08-31T12:21:52.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.830+0000 7fee66a00640 1 -- 172.21.15.164:0/4099822139 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335786 (secure 0 0 0) 0x7fee5800fad0 con 0x7fee4c0720f0 2024-08-31T12:21:52.833 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:21:52.835 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 msgr2=0x7fee4c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 0x7fee4c074600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee580058d0 tx=0x7fee58005860 comp rx=0 tx=0).stop 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 msgr2=0x7fee700c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fee60009790 tx=0x7fee60004040 comp rx=0 tx=0).stop 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 shutdown_connections 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fee4c0720f0 0x7fee4c074600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee7015bd00 0x7fee700cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee700ceab0 0x7fee70153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 --2- 172.21.15.164:0/4099822139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee700c88c0 0x7fee700c6c60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 >> 172.21.15.164:0/4099822139 conn(0x7fee7006e340 msgr2=0x7fee701518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 shutdown_connections 2024-08-31T12:21:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:21:52.834+0000 7fee75200640 1 -- 172.21.15.164:0/4099822139 wait complete. 2024-08-31T12:21:52.856 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-08-31T12:21:52.759518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":145112502,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1776,"num_read_kb":531930,"num_write":15436,"num_write_kb":694342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21102,"ondisk_log_size":21102,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1010016,"kb_used_data":288544,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":753964704,"statfs":{"total":773094113280,"available":772059856896,"internally_reserved":0,"allocated":295469056,"data_stored":292966388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":738643505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-414246163,"num_objects":-123,"num_object_clones":0,"num_object_copies":-492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":131,"num_read_kb":43,"num_write":202,"num_write_kb":9010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006369"},"pg_stats":[{"pgid":"2.1f","version":"56'59","reported_seq":156,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.855289+0000","last_change":"2024-08-31T12:13:45.679714+0000","last_active":"2024-08-31T12:21:23.855289+0000","last_peered":"2024-08-31T12:21:23.855289+0000","last_clean":"2024-08-31T12:21:23.855289+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:23.855289+0000","last_undegraded":"2024-08-31T12:21:23.855289+0000","last_fullsized":"2024-08-31T12:21:23.855289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:53.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"56'92","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702468+0000","last_change":"2024-08-31T12:19:51.077673+0000","last_active":"2024-08-31T12:21:44.702468+0000","last_peered":"2024-08-31T12:21:44.702468+0000","last_clean":"2024-08-31T12:21:44.702468+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:44.702468+0000","last_undegraded":"2024-08-31T12:21:44.702468+0000","last_fullsized":"2024-08-31T12:21:44.702468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:27.050879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"56'369","reported_seq":2518,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.956707+0000","last_change":"2024-08-31T12:19:50.981608+0000","last_active":"2024-08-31T12:21:42.956707+0000","last_peered":"2024-08-31T12:21:42.956707+0000","last_clean":"2024-08-31T12:21:42.956707+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:21:42.956707+0000","last_undegraded":"2024-08-31T12:21:42.956707+0000","last_fullsized":"2024-08-31T12:21:42.956707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:24:47.867907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":4130,"num_write":366,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"56'82","reported_seq":173,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.882760+0000","last_change":"2024-08-31T12:13:45.693484+0000","last_active":"2024-08-31T12:21:44.882760+0000","last_peered":"2024-08-31T12:21:44.882760+0000","last_clean":"2024-08-31T12:21:44.882760+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:21:44.882760+0000","last_undegraded":"2024-08-31T12:21:44.882760+0000","last_fullsized":"2024-08-31T12:21:44.882760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:16.960997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"56'87","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702878+0000","last_change":"2024-08-31T12:19:51.078041+0000","last_active":"2024-08-31T12:21:44.702878+0000","last_peered":"2024-08-31T12:21:44.702878+0000","last_clean":"2024-08-31T12:21:44.702878+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:21:44.702878+0000","last_undegraded":"2024-08-31T12:21:44.702878+0000","last_fullsized":"2024-08-31T12:21:44.702878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:40.429055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'352","reported_seq":2502,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.962110+0000","last_change":"2024-08-31T12:19:51.270521+0000","last_active":"2024-08-31T12:21:42.962110+0000","last_peered":"2024-08-31T12:21:42.962110+0000","last_clean":"2024-08-31T12:21:42.962110+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:21:42.962110+0000","last_undegraded":"2024-08-31T12:21:42.962110+0000","last_fullsized":"2024-08-31T12:21:42.962110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:42:30.397283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":4129,"num_write":351,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"56'1939","reported_seq":2038,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.851257+0000","last_change":"2024-08-31T12:13:45.673553+0000","last_active":"2024-08-31T12:21:41.851257+0000","last_peered":"2024-08-31T12:21:41.851257+0000","last_clean":"2024-08-31T12:21:41.851257+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:21:41.851257+0000","last_undegraded":"2024-08-31T12:21:41.851257+0000","last_fullsized":"2024-08-31T12:21:41.851257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":1939,"log_dups_size":0,"ondisk_log_size":1939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:49:46.472096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":38903,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"56'92","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.867645+0000","last_change":"2024-08-31T12:19:51.222939+0000","last_active":"2024-08-31T12:21:44.867645+0000","last_peered":"2024-08-31T12:21:44.867645+0000","last_clean":"2024-08-31T12:21:44.867645+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:44.867645+0000","last_undegraded":"2024-08-31T12:21:44.867645+0000","last_fullsized":"2024-08-31T12:21:44.867645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:45.439283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"56'369","reported_seq":2517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.932280+0000","last_change":"2024-08-31T12:19:51.265557+0000","last_active":"2024-08-31T12:21:42.932280+0000","last_peered":"2024-08-31T12:21:42.932280+0000","last_clean":"2024-08-31T12:21:42.932280+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:21:42.932280+0000","last_undegraded":"2024-08-31T12:21:42.932280+0000","last_fullsized":"2024-08-31T12:21:42.932280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:34.207533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":368,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"55'49","reported_seq":140,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.259207+0000","last_change":"2024-08-31T12:13:45.673079+0000","last_active":"2024-08-31T12:21:22.259207+0000","last_peered":"2024-08-31T12:21:22.259207+0000","last_clean":"2024-08-31T12:21:22.259207+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:22.259207+0000","last_undegraded":"2024-08-31T12:21:22.259207+0000","last_fullsized":"2024-08-31T12:21:22.259207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:47:18.297328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"56'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.687302+0000","last_change":"2024-08-31T12:19:51.191343+0000","last_active":"2024-08-31T12:21:44.687302+0000","last_peered":"2024-08-31T12:21:44.687302+0000","last_clean":"2024-08-31T12:21:44.687302+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:21:44.687302+0000","last_undegraded":"2024-08-31T12:21:44.687302+0000","last_fullsized":"2024-08-31T12:21:44.687302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:55.638854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"56'334","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.952216+0000","last_change":"2024-08-31T12:19:51.266908+0000","last_active":"2024-08-31T12:21:42.952216+0000","last_peered":"2024-08-31T12:21:42.952216+0000","last_clean":"2024-08-31T12:21:42.952216+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:21:42.952216+0000","last_undegraded":"2024-08-31T12:21:42.952216+0000","last_fullsized":"2024-08-31T12:21:42.952216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:53.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":334,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"56'88","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.674151+0000","last_change":"2024-08-31T12:19:51.182717+0000","last_active":"2024-08-31T12:21:44.674151+0000","last_peered":"2024-08-31T12:21:44.674151+0000","last_clean":"2024-08-31T12:21:44.674151+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:44.674151+0000","last_undegraded":"2024-08-31T12:21:44.674151+0000","last_fullsized":"2024-08-31T12:21:44.674151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:02:01.902388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"56'86","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.436458+0000","last_change":"2024-08-31T12:13:45.667250+0000","last_active":"2024-08-31T12:21:22.436458+0000","last_peered":"2024-08-31T12:21:22.436458+0000","last_clean":"2024-08-31T12:21:22.436458+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:22.436458+0000","last_undegraded":"2024-08-31T12:21:22.436458+0000","last_fullsized":"2024-08-31T12:21:22.436458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:23:45.763044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"56'339","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.936345+0000","last_change":"2024-08-31T12:19:50.893218+0000","last_active":"2024-08-31T12:21:42.936345+0000","last_peered":"2024-08-31T12:21:42.936345+0000","last_clean":"2024-08-31T12:21:42.936345+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:21:42.936345+0000","last_undegraded":"2024-08-31T12:21:42.936345+0000","last_fullsized":"2024-08-31T12:21:42.936345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:26.717821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":4130,"num_write":338,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"56'89","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.700791+0000","last_change":"2024-08-31T12:19:50.981970+0000","last_active":"2024-08-31T12:21:44.700791+0000","last_peered":"2024-08-31T12:21:44.700791+0000","last_clean":"2024-08-31T12:21:44.700791+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:44.700791+0000","last_undegraded":"2024-08-31T12:21:44.700791+0000","last_fullsized":"2024-08-31T12:21:44.700791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:50:55.324238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"42'23","reported_seq":110,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815017+0000","last_change":"2024-08-31T12:13:45.692346+0000","last_active":"2024-08-31T12:21:16.815017+0000","last_peered":"2024-08-31T12:21:16.815017+0000","last_clean":"2024-08-31T12:21:16.815017+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:16.815017+0000","last_undegraded":"2024-08-31T12:21:16.815017+0000","last_fullsized":"2024-08-31T12:21:16.815017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:01:28.105719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"56'363","reported_seq":2507,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.210429+0000","last_change":"2024-08-31T12:19:50.893757+0000","last_active":"2024-08-31T12:21:41.210429+0000","last_peered":"2024-08-31T12:21:41.210429+0000","last_clean":"2024-08-31T12:21:41.210429+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:21:41.210429+0000","last_undegraded":"2024-08-31T12:21:41.210429+0000","last_fullsized":"2024-08-31T12:21:41.210429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:38:01.625027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":4130,"num_write":360,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'93","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.691940+0000","last_change":"2024-08-31T12:19:51.043981+0000","last_active":"2024-08-31T12:21:44.691940+0000","last_peered":"2024-08-31T12:21:44.691940+0000","last_clean":"2024-08-31T12:21:44.691940+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:21:44.691940+0000","last_undegraded":"2024-08-31T12:21:44.691940+0000","last_fullsized":"2024-08-31T12:21:44.691940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:13.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'89","reported_seq":175,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.622280+0000","last_change":"2024-08-31T12:13:45.685039+0000","last_active":"2024-08-31T12:21:44.622280+0000","last_peered":"2024-08-31T12:21:44.622280+0000","last_clean":"2024-08-31T12:21:44.622280+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:21:44.622280+0000","last_undegraded":"2024-08-31T12:21:44.622280+0000","last_fullsized":"2024-08-31T12:21:44.622280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:14.230152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1335100,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":85,"num_write_kb":1364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"56'336","reported_seq":2487,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.193499+0000","last_change":"2024-08-31T12:19:50.982738+0000","last_active":"2024-08-31T12:21:41.193499+0000","last_peered":"2024-08-31T12:21:41.193499+0000","last_clean":"2024-08-31T12:21:41.193499+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:41.193499+0000","last_undegraded":"2024-08-31T12:21:41.193499+0000","last_fullsized":"2024-08-31T12:21:41.193499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:27:32.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":8232,"num_write":332,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'94","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.662649+0000","last_change":"2024-08-31T12:19:51.179971+0000","last_active":"2024-08-31T12:21:44.662649+0000","last_peered":"2024-08-31T12:21:44.662649+0000","last_clean":"2024-08-31T12:21:44.662649+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:44.662649+0000","last_undegraded":"2024-08-31T12:21:44.662649+0000","last_fullsized":"2024-08-31T12:21:44.662649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:49:48.420577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"56'9","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.089124+0000","last_change":"2024-08-31T12:21:50.089124+0000","last_active":"2024-08-31T12:21:50.089124+0000","last_peered":"2024-08-31T12:21:50.089124+0000","last_clean":"2024-08-31T12:21:50.089124+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:50.089124+0000","last_undegraded":"2024-08-31T12:21:50.089124+0000","last_fullsized":"2024-08-31T12:21:50.089124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.089039+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:59.686158+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"56'286","reported_seq":2434,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.615556+0000","last_change":"2024-08-31T12:19:51.271430+0000","last_active":"2024-08-31T12:21:44.615556+0000","last_peered":"2024-08-31T12:21:44.615556+0000","last_clean":"2024-08-31T12:21:44.615556+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:44.615556+0000","last_undegraded":"2024-08-31T12:21:44.615556+0000","last_fullsized":"2024-08-31T12:21:44.615556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:12.164256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":4132,"num_write":284,"num_write_kb":20569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"56'93","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.692714+0000","last_change":"2024-08-31T12:19:51.049750+0000","last_active":"2024-08-31T12:21:44.692714+0000","last_peered":"2024-08-31T12:21:44.692714+0000","last_clean":"2024-08-31T12:21:44.692714+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:44.692714+0000","last_undegraded":"2024-08-31T12:21:44.692714+0000","last_fullsized":"2024-08-31T12:21:44.692714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:52.154694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'9","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.902849+0000","last_change":"2024-08-31T12:13:45.675515+0000","last_active":"2024-08-31T12:21:40.902849+0000","last_peered":"2024-08-31T12:21:40.902849+0000","last_clean":"2024-08-31T12:21:40.902849+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:40.902849+0000","last_undegraded":"2024-08-31T12:21:40.902849+0000","last_fullsized":"2024-08-31T12:21:40.902849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:06:24.786226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'362","reported_seq":2503,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.961339+0000","last_change":"2024-08-31T12:19:51.267348+0000","last_active":"2024-08-31T12:21:42.961339+0000","last_peered":"2024-08-31T12:21:42.961339+0000","last_clean":"2024-08-31T12:21:42.961339+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:42.961339+0000","last_undegraded":"2024-08-31T12:21:42.961339+0000","last_fullsized":"2024-08-31T12:21:42.961339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:52:51.279879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":28,"num_write":360,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"56'88","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.697046+0000","last_change":"2024-08-31T12:19:51.047806+0000","last_active":"2024-08-31T12:21:44.697046+0000","last_peered":"2024-08-31T12:21:44.697046+0000","last_clean":"2024-08-31T12:21:44.697046+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:44.697046+0000","last_undegraded":"2024-08-31T12:21:44.697046+0000","last_fullsized":"2024-08-31T12:21:44.697046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:27:44.404451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'170","reported_seq":260,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.870150+0000","last_change":"2024-08-31T12:13:45.686542+0000","last_active":"2024-08-31T12:21:44.870150+0000","last_peered":"2024-08-31T12:21:44.870150+0000","last_clean":"2024-08-31T12:21:44.870150+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:44.870150+0000","last_undegraded":"2024-08-31T12:21:44.870150+0000","last_fullsized":"2024-08-31T12:21:44.870150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:12:10.676974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":414,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'358","reported_seq":2515,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.941074+0000","last_change":"2024-08-31T12:19:51.044689+0000","last_active":"2024-08-31T12:21:42.941074+0000","last_peered":"2024-08-31T12:21:42.941074+0000","last_clean":"2024-08-31T12:21:42.941074+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:21:42.941074+0000","last_undegraded":"2024-08-31T12:21:42.941074+0000","last_fullsized":"2024-08-31T12:21:42.941074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:00:11.862454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":356,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"56'90","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.673642+0000","last_change":"2024-08-31T12:19:51.184067+0000","last_active":"2024-08-31T12:21:44.673642+0000","last_peered":"2024-08-31T12:21:44.673642+0000","last_clean":"2024-08-31T12:21:44.673642+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:44.673642+0000","last_undegraded":"2024-08-31T12:21:44.673642+0000","last_fullsized":"2024-08-31T12:21:44.673642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:03.443847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"56'23","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.873021+0000","last_change":"2024-08-31T12:13:45.682876+0000","last_active":"2024-08-31T12:21:44.873021+0000","last_peered":"2024-08-31T12:21:44.873021+0000","last_clean":"2024-08-31T12:21:44.873021+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:44.873021+0000","last_undegraded":"2024-08-31T12:21:44.873021+0000","last_fullsized":"2024-08-31T12:21:44.873021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:06.605973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'374","reported_seq":2519,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.956824+0000","last_change":"2024-08-31T12:19:51.178915+0000","last_active":"2024-08-31T12:21:42.956824+0000","last_peered":"2024-08-31T12:21:42.956824+0000","last_clean":"2024-08-31T12:21:42.956824+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:21:42.956824+0000","last_undegraded":"2024-08-31T12:21:42.956824+0000","last_fullsized":"2024-08-31T12:21:42.956824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:55.684998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":32,"num_write":374,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"56'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.682091+0000","last_change":"2024-08-31T12:19:51.267618+0000","last_active":"2024-08-31T12:21:44.682091+0000","last_peered":"2024-08-31T12:21:44.682091+0000","last_clean":"2024-08-31T12:21:44.682091+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:44.682091+0000","last_undegraded":"2024-08-31T12:21:44.682091+0000","last_fullsized":"2024-08-31T12:21:44.682091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:57.623085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'3","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.855958+0000","last_change":"2024-08-31T12:13:45.694845+0000","last_active":"2024-08-31T12:21:23.855958+0000","last_peered":"2024-08-31T12:21:23.855958+0000","last_clean":"2024-08-31T12:21:23.855958+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:23.855958+0000","last_undegraded":"2024-08-31T12:21:23.855958+0000","last_fullsized":"2024-08-31T12:21:23.855958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:25:21.888431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'353","reported_seq":2496,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.952189+0000","last_change":"2024-08-31T12:19:51.175945+0000","last_active":"2024-08-31T12:21:42.952189+0000","last_peered":"2024-08-31T12:21:42.952189+0000","last_clean":"2024-08-31T12:21:42.952189+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:21:42.952189+0000","last_undegraded":"2024-08-31T12:21:42.952189+0000","last_fullsized":"2024-08-31T12:21:42.952189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:03:44.835939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":34,"num_write":352,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"56'97","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.685820+0000","last_change":"2024-08-31T12:19:50.892454+0000","last_active":"2024-08-31T12:21:44.685820+0000","last_peered":"2024-08-31T12:21:44.685820+0000","last_clean":"2024-08-31T12:21:44.685820+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:44.685820+0000","last_undegraded":"2024-08-31T12:21:44.685820+0000","last_fullsized":"2024-08-31T12:21:44.685820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:35:26.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"56'169","reported_seq":266,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.850019+0000","last_change":"2024-08-31T12:21:50.850019+0000","last_active":"2024-08-31T12:21:50.850019+0000","last_peered":"2024-08-31T12:21:50.850019+0000","last_clean":"2024-08-31T12:21:50.850019+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:50.850019+0000","last_undegraded":"2024-08-31T12:21:50.850019+0000","last_fullsized":"2024-08-31T12:21:50.850019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.849945+0000","objects_scrubbed":2,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:49.571172+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'320","reported_seq":2457,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.895131+0000","last_change":"2024-08-31T12:19:51.183892+0000","last_active":"2024-08-31T12:21:42.895131+0000","last_peered":"2024-08-31T12:21:42.895131+0000","last_clean":"2024-08-31T12:21:42.895131+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:21:42.895131+0000","last_undegraded":"2024-08-31T12:21:42.895131+0000","last_fullsized":"2024-08-31T12:21:42.895131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:30.314422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3300,"num_write":320,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"56'83","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.706479+0000","last_change":"2024-08-31T12:19:51.049351+0000","last_active":"2024-08-31T12:21:44.706479+0000","last_peered":"2024-08-31T12:21:44.706479+0000","last_clean":"2024-08-31T12:21:44.706479+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:44.706479+0000","last_undegraded":"2024-08-31T12:21:44.706479+0000","last_fullsized":"2024-08-31T12:21:44.706479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:40.766633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"56'146","reported_seq":375,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.858950+0000","last_change":"2024-08-31T12:13:45.690602+0000","last_active":"2024-08-31T12:21:44.858950+0000","last_peered":"2024-08-31T12:21:44.858950+0000","last_clean":"2024-08-31T12:21:44.858950+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:44.858950+0000","last_undegraded":"2024-08-31T12:21:44.858950+0000","last_fullsized":"2024-08-31T12:21:44.858950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:37.543806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":579228,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":146,"num_read_kb":661,"num_write":141,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"56'331","reported_seq":2475,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:41.200385+0000","last_change":"2024-08-31T12:19:51.184441+0000","last_active":"2024-08-31T12:21:41.200385+0000","last_peered":"2024-08-31T12:21:41.200385+0000","last_clean":"2024-08-31T12:21:41.200385+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:21:41.200385+0000","last_undegraded":"2024-08-31T12:21:41.200385+0000","last_fullsized":"2024-08-31T12:21:41.200385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:55:53.475438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":330,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"56'82","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.688409+0000","last_change":"2024-08-31T12:19:51.182725+0000","last_active":"2024-08-31T12:21:44.688409+0000","last_peered":"2024-08-31T12:21:44.688409+0000","last_clean":"2024-08-31T12:21:44.688409+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:44.688409+0000","last_undegraded":"2024-08-31T12:21:44.688409+0000","last_fullsized":"2024-08-31T12:21:44.688409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:17:40.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'101","reported_seq":193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:23.853778+0000","last_change":"2024-08-31T12:13:45.676844+0000","last_active":"2024-08-31T12:21:23.853778+0000","last_peered":"2024-08-31T12:21:23.853778+0000","last_clean":"2024-08-31T12:21:23.853778+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:21:23.853778+0000","last_undegraded":"2024-08-31T12:21:23.853778+0000","last_fullsized":"2024-08-31T12:21:23.853778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:38.069917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2517,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.072317+0000","last_change":"2024-08-31T12:19:51.075766+0000","last_active":"2024-08-31T12:21:17.072317+0000","last_peered":"2024-08-31T12:21:17.072317+0000","last_clean":"2024-08-31T12:21:17.072317+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:21:17.072317+0000","last_undegraded":"2024-08-31T12:21:17.072317+0000","last_fullsized":"2024-08-31T12:21:17.072317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:27.063933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"56'91","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.697333+0000","last_change":"2024-08-31T12:19:51.049809+0000","last_active":"2024-08-31T12:21:44.697333+0000","last_peered":"2024-08-31T12:21:44.697333+0000","last_clean":"2024-08-31T12:21:44.697333+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:44.697333+0000","last_undegraded":"2024-08-31T12:21:44.697333+0000","last_fullsized":"2024-08-31T12:21:44.697333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:03:05.060570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372650+0000","last_change":"2024-08-31T12:13:45.662740+0000","last_active":"2024-08-31T12:21:16.372650+0000","last_peered":"2024-08-31T12:21:16.372650+0000","last_clean":"2024-08-31T12:21:16.372650+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:16.372650+0000","last_undegraded":"2024-08-31T12:21:16.372650+0000","last_fullsized":"2024-08-31T12:21:16.372650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:05:29.013457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":180,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.069904+0000","last_change":"2024-08-31T12:13:38.543230+0000","last_active":"2024-08-31T12:21:17.069904+0000","last_peered":"2024-08-31T12:21:17.069904+0000","last_clean":"2024-08-31T12:21:17.069904+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:17.069904+0000","last_undegraded":"2024-08-31T12:21:17.069904+0000","last_fullsized":"2024-08-31T12:21:17.069904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:37.526092+0000","last_clean_scrub_stamp":"2024-08-31T12:13:37.526092+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:52.458097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'299","reported_seq":2440,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.874203+0000","last_change":"2024-08-31T12:19:51.191472+0000","last_active":"2024-08-31T12:21:42.874203+0000","last_peered":"2024-08-31T12:21:42.874203+0000","last_clean":"2024-08-31T12:21:42.874203+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:21:42.874203+0000","last_undegraded":"2024-08-31T12:21:42.874203+0000","last_fullsized":"2024-08-31T12:21:42.874203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:24.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":298,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"56'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.686450+0000","last_change":"2024-08-31T12:19:51.189350+0000","last_active":"2024-08-31T12:21:44.686450+0000","last_peered":"2024-08-31T12:21:44.686450+0000","last_clean":"2024-08-31T12:21:44.686450+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:44.686450+0000","last_undegraded":"2024-08-31T12:21:44.686450+0000","last_fullsized":"2024-08-31T12:21:44.686450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:01:23.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":87,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.815807+0000","last_change":"2024-08-31T12:13:45.699944+0000","last_active":"2024-08-31T12:21:16.815807+0000","last_peered":"2024-08-31T12:21:16.815807+0000","last_clean":"2024-08-31T12:21:16.815807+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:16.815807+0000","last_undegraded":"2024-08-31T12:21:16.815807+0000","last_fullsized":"2024-08-31T12:21:16.815807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:34.027842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'346","reported_seq":2486,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.876224+0000","last_change":"2024-08-31T12:19:51.265682+0000","last_active":"2024-08-31T12:21:44.876224+0000","last_peered":"2024-08-31T12:21:44.876224+0000","last_clean":"2024-08-31T12:21:44.876224+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:21:44.876224+0000","last_undegraded":"2024-08-31T12:21:44.876224+0000","last_fullsized":"2024-08-31T12:21:44.876224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:39.107402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":344,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"56'97","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702204+0000","last_change":"2024-08-31T12:19:50.894692+0000","last_active":"2024-08-31T12:21:44.702204+0000","last_peered":"2024-08-31T12:21:44.702204+0000","last_clean":"2024-08-31T12:21:44.702204+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:44.702204+0000","last_undegraded":"2024-08-31T12:21:44.702204+0000","last_fullsized":"2024-08-31T12:21:44.702204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:20.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"42'21","reported_seq":112,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.375268+0000","last_change":"2024-08-31T12:13:45.688223+0000","last_active":"2024-08-31T12:21:21.375268+0000","last_peered":"2024-08-31T12:21:21.375268+0000","last_clean":"2024-08-31T12:21:21.375268+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:21.375268+0000","last_undegraded":"2024-08-31T12:21:21.375268+0000","last_fullsized":"2024-08-31T12:21:21.375268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:41.611308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'324","reported_seq":2471,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.960212+0000","last_change":"2024-08-31T12:19:51.075472+0000","last_active":"2024-08-31T12:21:42.960212+0000","last_peered":"2024-08-31T12:21:42.960212+0000","last_clean":"2024-08-31T12:21:42.960212+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:21:42.960212+0000","last_undegraded":"2024-08-31T12:21:42.960212+0000","last_fullsized":"2024-08-31T12:21:42.960212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:57:35.585043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":36,"num_write":324,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"56'87","reported_seq":2200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.677463+0000","last_change":"2024-08-31T12:19:50.894566+0000","last_active":"2024-08-31T12:21:44.677463+0000","last_peered":"2024-08-31T12:21:44.677463+0000","last_clean":"2024-08-31T12:21:44.677463+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:44.677463+0000","last_undegraded":"2024-08-31T12:21:44.677463+0000","last_fullsized":"2024-08-31T12:21:44.677463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:23:28.837600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"56'107","reported_seq":199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.900187+0000","last_change":"2024-08-31T12:13:45.696678+0000","last_active":"2024-08-31T12:21:40.900187+0000","last_peered":"2024-08-31T12:21:40.900187+0000","last_clean":"2024-08-31T12:21:40.900187+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:40.900187+0000","last_undegraded":"2024-08-31T12:21:40.900187+0000","last_fullsized":"2024-08-31T12:21:40.900187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:21:20.813030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'346","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.904031+0000","last_change":"2024-08-31T12:19:51.190295+0000","last_active":"2024-08-31T12:21:42.904031+0000","last_peered":"2024-08-31T12:21:42.904031+0000","last_clean":"2024-08-31T12:21:42.904031+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:21:42.904031+0000","last_undegraded":"2024-08-31T12:21:42.904031+0000","last_fullsized":"2024-08-31T12:21:42.904031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:44.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":32,"num_write":346,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"56'65","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.475443+0000","last_change":"2024-08-31T12:21:50.475443+0000","last_active":"2024-08-31T12:21:50.475443+0000","last_peered":"2024-08-31T12:21:50.475443+0000","last_clean":"2024-08-31T12:21:50.475443+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:50.475443+0000","last_undegraded":"2024-08-31T12:21:50.475443+0000","last_fullsized":"2024-08-31T12:21:50.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'65","last_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_deep_scrub":"56'65","last_deep_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.475366+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:32.691010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"56'19","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.292140+0000","last_change":"2024-08-31T12:13:45.686317+0000","last_active":"2024-08-31T12:21:22.292140+0000","last_peered":"2024-08-31T12:21:22.292140+0000","last_clean":"2024-08-31T12:21:22.292140+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:22.292140+0000","last_undegraded":"2024-08-31T12:21:22.292140+0000","last_fullsized":"2024-08-31T12:21:22.292140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:09.830188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'366","reported_seq":2522,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.966531+0000","last_change":"2024-08-31T12:19:51.220620+0000","last_active":"2024-08-31T12:21:42.966531+0000","last_peered":"2024-08-31T12:21:42.966531+0000","last_clean":"2024-08-31T12:21:42.966531+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:42.966531+0000","last_undegraded":"2024-08-31T12:21:42.966531+0000","last_fullsized":"2024-08-31T12:21:42.966531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:46.983088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":4137,"num_write":364,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"56'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.865553+0000","last_change":"2024-08-31T12:19:51.184941+0000","last_active":"2024-08-31T12:21:44.865553+0000","last_peered":"2024-08-31T12:21:44.865553+0000","last_clean":"2024-08-31T12:21:44.865553+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:21:44.865553+0000","last_undegraded":"2024-08-31T12:21:44.865553+0000","last_fullsized":"2024-08-31T12:21:44.865553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:58:57.275553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"55'298","reported_seq":409,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.865457+0000","last_change":"2024-08-31T12:13:45.681444+0000","last_active":"2024-08-31T12:21:40.865457+0000","last_peered":"2024-08-31T12:21:40.865457+0000","last_clean":"2024-08-31T12:21:40.865457+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:40.865457+0000","last_undegraded":"2024-08-31T12:21:40.865457+0000","last_fullsized":"2024-08-31T12:21:40.865457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:21.809734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2502,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:17.073988+0000","last_change":"2024-08-31T12:19:51.076234+0000","last_active":"2024-08-31T12:21:17.073988+0000","last_peered":"2024-08-31T12:21:17.073988+0000","last_clean":"2024-08-31T12:21:17.073988+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:21:17.073988+0000","last_undegraded":"2024-08-31T12:21:17.073988+0000","last_fullsized":"2024-08-31T12:21:17.073988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:19.257551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"56'90","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.568257+0000","last_change":"2024-08-31T12:21:49.568257+0000","last_active":"2024-08-31T12:21:49.568257+0000","last_peered":"2024-08-31T12:21:49.568257+0000","last_clean":"2024-08-31T12:21:49.568257+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:49.568257+0000","last_undegraded":"2024-08-31T12:21:49.568257+0000","last_fullsized":"2024-08-31T12:21:49.568257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.568128+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:34:33.999379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"56'3","reported_seq":86,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.971231+0000","last_change":"2024-08-31T12:13:45.668064+0000","last_active":"2024-08-31T12:21:16.971231+0000","last_peered":"2024-08-31T12:21:16.971231+0000","last_clean":"2024-08-31T12:21:16.971231+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:16.971231+0000","last_undegraded":"2024-08-31T12:21:16.971231+0000","last_fullsized":"2024-08-31T12:21:16.971231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:14.659263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'320","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.966024+0000","last_change":"2024-08-31T12:19:51.076307+0000","last_active":"2024-08-31T12:21:42.966024+0000","last_peered":"2024-08-31T12:21:42.966024+0000","last_clean":"2024-08-31T12:21:42.966024+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:21:42.966024+0000","last_undegraded":"2024-08-31T12:21:42.966024+0000","last_fullsized":"2024-08-31T12:21:42.966024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:59.114734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":4133,"num_write":318,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"56'101","reported_seq":2220,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.692053+0000","last_change":"2024-08-31T12:19:51.178571+0000","last_active":"2024-08-31T12:21:44.692053+0000","last_peered":"2024-08-31T12:21:44.692053+0000","last_clean":"2024-08-31T12:21:44.692053+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:21:44.692053+0000","last_undegraded":"2024-08-31T12:21:44.692053+0000","last_fullsized":"2024-08-31T12:21:44.692053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:51.393024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.372653+0000","last_change":"2024-08-31T12:13:45.677602+0000","last_active":"2024-08-31T12:21:16.372653+0000","last_peered":"2024-08-31T12:21:16.372653+0000","last_clean":"2024-08-31T12:21:16.372653+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:16.372653+0000","last_undegraded":"2024-08-31T12:21:16.372653+0000","last_fullsized":"2024-08-31T12:21:16.372653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:23:30.944647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'304","reported_seq":2440,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.610213+0000","last_change":"2024-08-31T12:19:51.184295+0000","last_active":"2024-08-31T12:21:44.610213+0000","last_peered":"2024-08-31T12:21:44.610213+0000","last_clean":"2024-08-31T12:21:44.610213+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:21:44.610213+0000","last_undegraded":"2024-08-31T12:21:44.610213+0000","last_fullsized":"2024-08-31T12:21:44.610213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:25.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":302,"num_write_kb":32911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"56'87","reported_seq":2201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.882480+0000","last_change":"2024-08-31T12:19:51.175019+0000","last_active":"2024-08-31T12:21:44.882480+0000","last_peered":"2024-08-31T12:21:44.882480+0000","last_clean":"2024-08-31T12:21:44.882480+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:44.882480+0000","last_undegraded":"2024-08-31T12:21:44.882480+0000","last_fullsized":"2024-08-31T12:21:44.882480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:49.573391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"55'128","reported_seq":226,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.696474+0000","last_change":"2024-08-31T12:13:45.686125+0000","last_active":"2024-08-31T12:21:21.696474+0000","last_peered":"2024-08-31T12:21:21.696474+0000","last_clean":"2024-08-31T12:21:21.696474+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:21.696474+0000","last_undegraded":"2024-08-31T12:21:21.696474+0000","last_fullsized":"2024-08-31T12:21:21.696474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:17:26.467577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":28704,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'333","reported_seq":2481,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.978190+0000","last_change":"2024-08-31T12:19:51.189127+0000","last_active":"2024-08-31T12:21:42.978190+0000","last_peered":"2024-08-31T12:21:42.978190+0000","last_clean":"2024-08-31T12:21:42.978190+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:21:42.978190+0000","last_undegraded":"2024-08-31T12:21:42.978190+0000","last_fullsized":"2024-08-31T12:21:42.978190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:53.515083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":332,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"56'83","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.687420+0000","last_change":"2024-08-31T12:19:50.893633+0000","last_active":"2024-08-31T12:21:44.687420+0000","last_peered":"2024-08-31T12:21:44.687420+0000","last_clean":"2024-08-31T12:21:44.687420+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:21:44.687420+0000","last_undegraded":"2024-08-31T12:21:44.687420+0000","last_fullsized":"2024-08-31T12:21:44.687420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:51:49.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'171","reported_seq":278,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:40.894589+0000","last_change":"2024-08-31T12:13:45.683105+0000","last_active":"2024-08-31T12:21:40.894589+0000","last_peered":"2024-08-31T12:21:40.894589+0000","last_clean":"2024-08-31T12:21:40.894589+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:40.894589+0000","last_undegraded":"2024-08-31T12:21:40.894589+0000","last_fullsized":"2024-08-31T12:21:40.894589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:39.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":40983,"num_write":164,"num_write_kb":12382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'341","reported_seq":2492,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.887916+0000","last_change":"2024-08-31T12:19:51.048401+0000","last_active":"2024-08-31T12:21:44.887916+0000","last_peered":"2024-08-31T12:21:44.887916+0000","last_clean":"2024-08-31T12:21:44.887916+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:21:44.887916+0000","last_undegraded":"2024-08-31T12:21:44.887916+0000","last_fullsized":"2024-08-31T12:21:44.887916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:17.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":338,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"56'86","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.684417+0000","last_change":"2024-08-31T12:19:51.177535+0000","last_active":"2024-08-31T12:21:44.684417+0000","last_peered":"2024-08-31T12:21:44.684417+0000","last_clean":"2024-08-31T12:21:44.684417+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:21:44.684417+0000","last_undegraded":"2024-08-31T12:21:44.684417+0000","last_fullsized":"2024-08-31T12:21:44.684417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:22.493379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"56'250","reported_seq":346,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.984334+0000","last_change":"2024-08-31T12:13:45.688563+0000","last_active":"2024-08-31T12:21:42.984334+0000","last_peered":"2024-08-31T12:21:42.984334+0000","last_clean":"2024-08-31T12:21:42.984334+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:42.984334+0000","last_undegraded":"2024-08-31T12:21:42.984334+0000","last_fullsized":"2024-08-31T12:21:42.984334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:24:41.461811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":12307,"num_write":250,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'323","reported_seq":2476,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.958550+0000","last_change":"2024-08-31T12:19:51.266455+0000","last_active":"2024-08-31T12:21:42.958550+0000","last_peered":"2024-08-31T12:21:42.958550+0000","last_clean":"2024-08-31T12:21:42.958550+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:21:42.958550+0000","last_undegraded":"2024-08-31T12:21:42.958550+0000","last_fullsized":"2024-08-31T12:21:42.958550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:41.440357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":4139,"num_write":322,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"56'90","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702584+0000","last_change":"2024-08-31T12:19:51.078268+0000","last_active":"2024-08-31T12:21:44.702584+0000","last_peered":"2024-08-31T12:21:44.702584+0000","last_clean":"2024-08-31T12:21:44.702584+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:44.702584+0000","last_undegraded":"2024-08-31T12:21:44.702584+0000","last_fullsized":"2024-08-31T12:21:44.702584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:07:38.413894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'25","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.096554+0000","last_change":"2024-08-31T12:21:49.096554+0000","last_active":"2024-08-31T12:21:49.096554+0000","last_peered":"2024-08-31T12:21:49.096554+0000","last_clean":"2024-08-31T12:21:49.096554+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:49.096554+0000","last_undegraded":"2024-08-31T12:21:49.096554+0000","last_fullsized":"2024-08-31T12:21:49.096554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.096488+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:21.965086+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'358","reported_seq":2503,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.938611+0000","last_change":"2024-08-31T12:19:50.978531+0000","last_active":"2024-08-31T12:21:42.938611+0000","last_peered":"2024-08-31T12:21:42.938611+0000","last_clean":"2024-08-31T12:21:42.938611+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:42.938611+0000","last_undegraded":"2024-08-31T12:21:42.938611+0000","last_fullsized":"2024-08-31T12:21:42.938611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:07.225950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":350,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"56'105","reported_seq":2219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.675239+0000","last_change":"2024-08-31T12:19:51.271132+0000","last_active":"2024-08-31T12:21:44.675239+0000","last_peered":"2024-08-31T12:21:44.675239+0000","last_clean":"2024-08-31T12:21:44.675239+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:44.675239+0000","last_undegraded":"2024-08-31T12:21:44.675239+0000","last_fullsized":"2024-08-31T12:21:44.675239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:14.931872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"56'6","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.601108+0000","last_change":"2024-08-31T12:21:50.601108+0000","last_active":"2024-08-31T12:21:50.601108+0000","last_peered":"2024-08-31T12:21:50.601108+0000","last_clean":"2024-08-31T12:21:50.601108+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:50.601108+0000","last_undegraded":"2024-08-31T12:21:50.601108+0000","last_fullsized":"2024-08-31T12:21:50.601108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.601036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:36.462135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'338","reported_seq":2486,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.880178+0000","last_change":"2024-08-31T12:19:51.051597+0000","last_active":"2024-08-31T12:21:44.880178+0000","last_peered":"2024-08-31T12:21:44.880178+0000","last_clean":"2024-08-31T12:21:44.880178+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:21:44.880178+0000","last_undegraded":"2024-08-31T12:21:44.880178+0000","last_fullsized":"2024-08-31T12:21:44.880178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:20.640303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":338,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2458,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.919644+0000","last_change":"2024-08-31T12:19:51.050547+0000","last_active":"2024-08-31T12:21:42.919644+0000","last_peered":"2024-08-31T12:21:42.919644+0000","last_clean":"2024-08-31T12:21:42.919644+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:21:42.919644+0000","last_undegraded":"2024-08-31T12:21:42.919644+0000","last_fullsized":"2024-08-31T12:21:42.919644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:21:34.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"56'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.692880+0000","last_change":"2024-08-31T12:19:51.051914+0000","last_active":"2024-08-31T12:21:44.692880+0000","last_peered":"2024-08-31T12:21:44.692880+0000","last_clean":"2024-08-31T12:21:44.692880+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:44.692880+0000","last_undegraded":"2024-08-31T12:21:44.692880+0000","last_fullsized":"2024-08-31T12:21:44.692880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:40.077019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"33'221","reported_seq":311,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.134511+0000","last_change":"2024-08-31T12:13:45.658691+0000","last_active":"2024-08-31T12:21:22.134511+0000","last_peered":"2024-08-31T12:21:22.134511+0000","last_clean":"2024-08-31T12:21:22.134511+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:21:22.134511+0000","last_undegraded":"2024-08-31T12:21:22.134511+0000","last_fullsized":"2024-08-31T12:21:22.134511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:55.203944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'327","reported_seq":2473,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.979100+0000","last_change":"2024-08-31T12:19:51.192804+0000","last_active":"2024-08-31T12:21:42.979100+0000","last_peered":"2024-08-31T12:21:42.979100+0000","last_clean":"2024-08-31T12:21:42.979100+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:21:42.979100+0000","last_undegraded":"2024-08-31T12:21:42.979100+0000","last_fullsized":"2024-08-31T12:21:42.979100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:57.886915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":326,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"56'109","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.706374+0000","last_change":"2024-08-31T12:19:51.068760+0000","last_active":"2024-08-31T12:21:44.706374+0000","last_peered":"2024-08-31T12:21:44.706374+0000","last_clean":"2024-08-31T12:21:44.706374+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:44.706374+0000","last_undegraded":"2024-08-31T12:21:44.706374+0000","last_fullsized":"2024-08-31T12:21:44.706374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:31:04.217251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"42'24","reported_seq":111,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:16.812502+0000","last_change":"2024-08-31T12:13:45.680307+0000","last_active":"2024-08-31T12:21:16.812502+0000","last_peered":"2024-08-31T12:21:16.812502+0000","last_clean":"2024-08-31T12:21:16.812502+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:16.812502+0000","last_undegraded":"2024-08-31T12:21:16.812502+0000","last_fullsized":"2024-08-31T12:21:16.812502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:05.296518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"42'102","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:22.366771+0000","last_change":"2024-08-31T12:13:45.676309+0000","last_active":"2024-08-31T12:21:22.366771+0000","last_peered":"2024-08-31T12:21:22.366771+0000","last_clean":"2024-08-31T12:21:22.366771+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:22.366771+0000","last_undegraded":"2024-08-31T12:21:22.366771+0000","last_fullsized":"2024-08-31T12:21:22.366771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:29.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"56'90","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.693195+0000","last_change":"2024-08-31T12:19:51.051245+0000","last_active":"2024-08-31T12:21:44.693195+0000","last_peered":"2024-08-31T12:21:44.693195+0000","last_clean":"2024-08-31T12:21:44.693195+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:21:44.693195+0000","last_undegraded":"2024-08-31T12:21:44.693195+0000","last_fullsized":"2024-08-31T12:21:44.693195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:46:59.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'305","reported_seq":2439,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.883667+0000","last_change":"2024-08-31T12:19:51.050599+0000","last_active":"2024-08-31T12:21:44.883667+0000","last_peered":"2024-08-31T12:21:44.883667+0000","last_clean":"2024-08-31T12:21:44.883667+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:21:44.883667+0000","last_undegraded":"2024-08-31T12:21:44.883667+0000","last_fullsized":"2024-08-31T12:21:44.883667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:25:39.529445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":304,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'58","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:21.390893+0000","last_change":"2024-08-31T12:13:45.692735+0000","last_active":"2024-08-31T12:21:21.390893+0000","last_peered":"2024-08-31T12:21:21.390893+0000","last_clean":"2024-08-31T12:21:21.390893+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:21.390893+0000","last_undegraded":"2024-08-31T12:21:21.390893+0000","last_fullsized":"2024-08-31T12:21:21.390893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:44.624163+0000","last_clean_scrub_stamp":"2024-08-31T12:13:44.624163+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:19:40.089504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"56'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.658133+0000","last_change":"2024-08-31T12:19:51.221287+0000","last_active":"2024-08-31T12:21:44.658133+0000","last_peered":"2024-08-31T12:21:44.658133+0000","last_clean":"2024-08-31T12:21:44.658133+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:44.658133+0000","last_undegraded":"2024-08-31T12:21:44.658133+0000","last_fullsized":"2024-08-31T12:21:44.658133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:26.700201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'322","reported_seq":2476,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.941137+0000","last_change":"2024-08-31T12:19:50.983158+0000","last_active":"2024-08-31T12:21:42.941137+0000","last_peered":"2024-08-31T12:21:42.941137+0000","last_clean":"2024-08-31T12:21:42.941137+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:21:42.941137+0000","last_undegraded":"2024-08-31T12:21:42.941137+0000","last_fullsized":"2024-08-31T12:21:42.941137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.643813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":8234,"num_write":320,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"56'109","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.686364+0000","last_change":"2024-08-31T12:19:51.269244+0000","last_active":"2024-08-31T12:21:44.686364+0000","last_peered":"2024-08-31T12:21:44.686364+0000","last_clean":"2024-08-31T12:21:44.686364+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:44.686364+0000","last_undegraded":"2024-08-31T12:21:44.686364+0000","last_fullsized":"2024-08-31T12:21:44.686364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:56.132161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"56'111","reported_seq":2224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.675100+0000","last_change":"2024-08-31T12:19:50.981299+0000","last_active":"2024-08-31T12:21:44.675100+0000","last_peered":"2024-08-31T12:21:44.675100+0000","last_clean":"2024-08-31T12:21:44.675100+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:44.675100+0000","last_undegraded":"2024-08-31T12:21:44.675100+0000","last_fullsized":"2024-08-31T12:21:44.675100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:46:35.055501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"56'101","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.664866+0000","last_change":"2024-08-31T12:19:51.186593+0000","last_active":"2024-08-31T12:21:44.664866+0000","last_peered":"2024-08-31T12:21:44.664866+0000","last_clean":"2024-08-31T12:21:44.664866+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:21:44.664866+0000","last_undegraded":"2024-08-31T12:21:44.664866+0000","last_fullsized":"2024-08-31T12:21:44.664866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:04.722761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"56'99","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.704089+0000","last_change":"2024-08-31T12:19:51.074951+0000","last_active":"2024-08-31T12:21:44.704089+0000","last_peered":"2024-08-31T12:21:44.704089+0000","last_clean":"2024-08-31T12:21:44.704089+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:44.704089+0000","last_undegraded":"2024-08-31T12:21:44.704089+0000","last_fullsized":"2024-08-31T12:21:44.704089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:59:00.684606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"56'80","reported_seq":2194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.699435+0000","last_change":"2024-08-31T12:19:51.185342+0000","last_active":"2024-08-31T12:21:44.699435+0000","last_peered":"2024-08-31T12:21:44.699435+0000","last_clean":"2024-08-31T12:21:44.699435+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:44.699435+0000","last_undegraded":"2024-08-31T12:21:44.699435+0000","last_fullsized":"2024-08-31T12:21:44.699435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:43.897575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"56'73","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.679184+0000","last_change":"2024-08-31T12:19:51.181704+0000","last_active":"2024-08-31T12:21:44.679184+0000","last_peered":"2024-08-31T12:21:44.679184+0000","last_clean":"2024-08-31T12:21:44.679184+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:44.679184+0000","last_undegraded":"2024-08-31T12:21:44.679184+0000","last_fullsized":"2024-08-31T12:21:44.679184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:03.178489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"56'109","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.672334+0000","last_change":"2024-08-31T12:19:51.271453+0000","last_active":"2024-08-31T12:21:44.672334+0000","last_peered":"2024-08-31T12:21:44.672334+0000","last_clean":"2024-08-31T12:21:44.672334+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:44.672334+0000","last_undegraded":"2024-08-31T12:21:44.672334+0000","last_fullsized":"2024-08-31T12:21:44.672334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:08:45.605808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"56'83","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702770+0000","last_change":"2024-08-31T12:19:51.078039+0000","last_active":"2024-08-31T12:21:44.702770+0000","last_peered":"2024-08-31T12:21:44.702770+0000","last_clean":"2024-08-31T12:21:44.702770+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:21:44.702770+0000","last_undegraded":"2024-08-31T12:21:44.702770+0000","last_fullsized":"2024-08-31T12:21:44.702770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:29.368356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"56'93","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.668898+0000","last_change":"2024-08-31T12:19:51.186883+0000","last_active":"2024-08-31T12:21:44.668898+0000","last_peered":"2024-08-31T12:21:44.668898+0000","last_clean":"2024-08-31T12:21:44.668898+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:21:44.668898+0000","last_undegraded":"2024-08-31T12:21:44.668898+0000","last_fullsized":"2024-08-31T12:21:44.668898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:08.504264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"56'93","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.703961+0000","last_change":"2024-08-31T12:19:51.064708+0000","last_active":"2024-08-31T12:21:44.703961+0000","last_peered":"2024-08-31T12:21:44.703961+0000","last_clean":"2024-08-31T12:21:44.703961+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:21:44.703961+0000","last_undegraded":"2024-08-31T12:21:44.703961+0000","last_fullsized":"2024-08-31T12:21:44.703961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:09.085855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"56'96","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.673331+0000","last_change":"2024-08-31T12:19:51.223300+0000","last_active":"2024-08-31T12:21:44.673331+0000","last_peered":"2024-08-31T12:21:44.673331+0000","last_clean":"2024-08-31T12:21:44.673331+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:44.673331+0000","last_undegraded":"2024-08-31T12:21:44.673331+0000","last_fullsized":"2024-08-31T12:21:44.673331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:32:18.034547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"56'90","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.688306+0000","last_change":"2024-08-31T12:19:51.048787+0000","last_active":"2024-08-31T12:21:44.688306+0000","last_peered":"2024-08-31T12:21:44.688306+0000","last_clean":"2024-08-31T12:21:44.688306+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:21:44.688306+0000","last_undegraded":"2024-08-31T12:21:44.688306+0000","last_fullsized":"2024-08-31T12:21:44.688306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:11:02.319788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"56'97","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.684704+0000","last_change":"2024-08-31T12:19:50.893976+0000","last_active":"2024-08-31T12:21:44.684704+0000","last_peered":"2024-08-31T12:21:44.684704+0000","last_clean":"2024-08-31T12:21:44.684704+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:21:44.684704+0000","last_undegraded":"2024-08-31T12:21:44.684704+0000","last_fullsized":"2024-08-31T12:21:44.684704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:31.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"56'85","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.680387+0000","last_change":"2024-08-31T12:19:51.192143+0000","last_active":"2024-08-31T12:21:44.680387+0000","last_peered":"2024-08-31T12:21:44.680387+0000","last_clean":"2024-08-31T12:21:44.680387+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:21:44.680387+0000","last_undegraded":"2024-08-31T12:21:44.680387+0000","last_fullsized":"2024-08-31T12:21:44.680387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:03:48.542655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"56'89","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.699125+0000","last_change":"2024-08-31T12:19:50.982520+0000","last_active":"2024-08-31T12:21:44.699125+0000","last_peered":"2024-08-31T12:21:44.699125+0000","last_clean":"2024-08-31T12:21:44.699125+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:44.699125+0000","last_undegraded":"2024-08-31T12:21:44.699125+0000","last_fullsized":"2024-08-31T12:21:44.699125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:56:34.588788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"56'95","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.669010+0000","last_change":"2024-08-31T12:19:51.192768+0000","last_active":"2024-08-31T12:21:44.669010+0000","last_peered":"2024-08-31T12:21:44.669010+0000","last_clean":"2024-08-31T12:21:44.669010+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:21:44.669010+0000","last_undegraded":"2024-08-31T12:21:44.669010+0000","last_fullsized":"2024-08-31T12:21:44.669010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:39.267549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"56'97","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.684754+0000","last_change":"2024-08-31T12:19:51.185985+0000","last_active":"2024-08-31T12:21:44.684754+0000","last_peered":"2024-08-31T12:21:44.684754+0000","last_clean":"2024-08-31T12:21:44.684754+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:21:44.684754+0000","last_undegraded":"2024-08-31T12:21:44.684754+0000","last_fullsized":"2024-08-31T12:21:44.684754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:21.405555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"56'85","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702948+0000","last_change":"2024-08-31T12:19:51.063460+0000","last_active":"2024-08-31T12:21:44.702948+0000","last_peered":"2024-08-31T12:21:44.702948+0000","last_clean":"2024-08-31T12:21:44.702948+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:21:44.702948+0000","last_undegraded":"2024-08-31T12:21:44.702948+0000","last_fullsized":"2024-08-31T12:21:44.702948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:33.292394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"56'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.681458+0000","last_change":"2024-08-31T12:19:51.174772+0000","last_active":"2024-08-31T12:21:44.681458+0000","last_peered":"2024-08-31T12:21:44.681458+0000","last_clean":"2024-08-31T12:21:44.681458+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:21:44.681458+0000","last_undegraded":"2024-08-31T12:21:44.681458+0000","last_fullsized":"2024-08-31T12:21:44.681458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:54:29.129773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"56'81","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.683068+0000","last_change":"2024-08-31T12:19:51.181127+0000","last_active":"2024-08-31T12:21:44.683068+0000","last_peered":"2024-08-31T12:21:44.683068+0000","last_clean":"2024-08-31T12:21:44.683068+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:21:44.683068+0000","last_undegraded":"2024-08-31T12:21:44.683068+0000","last_fullsized":"2024-08-31T12:21:44.683068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:44:26.484043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"56'76","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.684832+0000","last_change":"2024-08-31T12:19:50.892823+0000","last_active":"2024-08-31T12:21:44.684832+0000","last_peered":"2024-08-31T12:21:44.684832+0000","last_clean":"2024-08-31T12:21:44.684832+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:21:44.684832+0000","last_undegraded":"2024-08-31T12:21:44.684832+0000","last_fullsized":"2024-08-31T12:21:44.684832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:37.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"56'92","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.686266+0000","last_change":"2024-08-31T12:19:50.893929+0000","last_active":"2024-08-31T12:21:44.686266+0000","last_peered":"2024-08-31T12:21:44.686266+0000","last_clean":"2024-08-31T12:21:44.686266+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:21:44.686266+0000","last_undegraded":"2024-08-31T12:21:44.686266+0000","last_fullsized":"2024-08-31T12:21:44.686266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:33.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"56'98","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.686588+0000","last_change":"2024-08-31T12:19:50.894286+0000","last_active":"2024-08-31T12:21:44.686588+0000","last_peered":"2024-08-31T12:21:44.686588+0000","last_clean":"2024-08-31T12:21:44.686588+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:44.686588+0000","last_undegraded":"2024-08-31T12:21:44.686588+0000","last_fullsized":"2024-08-31T12:21:44.686588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:11.536744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"56'84","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.675852+0000","last_change":"2024-08-31T12:19:51.225674+0000","last_active":"2024-08-31T12:21:44.675852+0000","last_peered":"2024-08-31T12:21:44.675852+0000","last_clean":"2024-08-31T12:21:44.675852+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:44.675852+0000","last_undegraded":"2024-08-31T12:21:44.675852+0000","last_fullsized":"2024-08-31T12:21:44.675852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:58.545098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"56'74","reported_seq":2188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.707036+0000","last_change":"2024-08-31T12:19:51.040117+0000","last_active":"2024-08-31T12:21:44.707036+0000","last_peered":"2024-08-31T12:21:44.707036+0000","last_clean":"2024-08-31T12:21:44.707036+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:44.707036+0000","last_undegraded":"2024-08-31T12:21:44.707036+0000","last_fullsized":"2024-08-31T12:21:44.707036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:02.594079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"56'105","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.688895+0000","last_change":"2024-08-31T12:19:50.892284+0000","last_active":"2024-08-31T12:21:44.688895+0000","last_peered":"2024-08-31T12:21:44.688895+0000","last_clean":"2024-08-31T12:21:44.688895+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:44.688895+0000","last_undegraded":"2024-08-31T12:21:44.688895+0000","last_fullsized":"2024-08-31T12:21:44.688895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:08:03.924404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"56'92","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.656946+0000","last_change":"2024-08-31T12:19:51.267262+0000","last_active":"2024-08-31T12:21:44.656946+0000","last_peered":"2024-08-31T12:21:44.656946+0000","last_clean":"2024-08-31T12:21:44.656946+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:44.656946+0000","last_undegraded":"2024-08-31T12:21:44.656946+0000","last_fullsized":"2024-08-31T12:21:44.656946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:43.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"56'102","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702179+0000","last_change":"2024-08-31T12:19:50.893034+0000","last_active":"2024-08-31T12:21:44.702179+0000","last_peered":"2024-08-31T12:21:44.702179+0000","last_clean":"2024-08-31T12:21:44.702179+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:44.702179+0000","last_undegraded":"2024-08-31T12:21:44.702179+0000","last_fullsized":"2024-08-31T12:21:44.702179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:43.248554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"56'76","reported_seq":2191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.872978+0000","last_change":"2024-08-31T12:19:51.264462+0000","last_active":"2024-08-31T12:21:44.872978+0000","last_peered":"2024-08-31T12:21:44.872978+0000","last_clean":"2024-08-31T12:21:44.872978+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:44.872978+0000","last_undegraded":"2024-08-31T12:21:44.872978+0000","last_fullsized":"2024-08-31T12:21:44.872978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:25:42.905157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"56'90","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.702602+0000","last_change":"2024-08-31T12:19:51.075411+0000","last_active":"2024-08-31T12:21:44.702602+0000","last_peered":"2024-08-31T12:21:44.702602+0000","last_clean":"2024-08-31T12:21:44.702602+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:21:44.702602+0000","last_undegraded":"2024-08-31T12:21:44.702602+0000","last_fullsized":"2024-08-31T12:21:44.702602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:36.650512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"56'75","reported_seq":2189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.698452+0000","last_change":"2024-08-31T12:19:51.075045+0000","last_active":"2024-08-31T12:21:44.698452+0000","last_peered":"2024-08-31T12:21:44.698452+0000","last_clean":"2024-08-31T12:21:44.698452+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:21:44.698452+0000","last_undegraded":"2024-08-31T12:21:44.698452+0000","last_fullsized":"2024-08-31T12:21:44.698452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:45.340712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"56'86","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.678970+0000","last_change":"2024-08-31T12:19:50.894206+0000","last_active":"2024-08-31T12:21:44.678970+0000","last_peered":"2024-08-31T12:21:44.678970+0000","last_clean":"2024-08-31T12:21:44.678970+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:21:44.678970+0000","last_undegraded":"2024-08-31T12:21:44.678970+0000","last_fullsized":"2024-08-31T12:21:44.678970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:36:32.545870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1223,"num_read_kb":65823,"num_write":10786,"num_write_kb":548212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10841,"ondisk_log_size":10841,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5791,"ondisk_log_size":5791,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144522134,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":487,"num_read_kb":466052,"num_write":4549,"num_write_kb":144502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":289103872,"data_stored":289044268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4398,"ondisk_log_size":4398,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137480,"kb_used_data":25784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94234360,"statfs":{"total":96636764160,"available":96495984640,"internally_reserved":0,"allocated":26402816,"data_stored":26087849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106440,"kb_used_data":21112,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94265400,"statfs":{"total":96636764160,"available":96527769600,"internally_reserved":0,"allocated":21618688,"data_stored":21314193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509543,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119884,"kb_used_data":34556,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251956,"statfs":{"total":96636764160,"available":96514002944,"internally_reserved":0,"allocated":35385344,"data_stored":35066793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509542,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139212,"kb_used_data":53884,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232628,"statfs":{"total":96636764160,"available":96494211072,"internally_reserved":0,"allocated":55177216,"data_stored":54869207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96656,"kb_used_data":25216,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94275184,"statfs":{"total":96636764160,"available":96537788416,"internally_reserved":0,"allocated":25821184,"data_stored":25509169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115152,"kb_used_data":33984,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94256688,"statfs":{"total":96636764160,"available":96518848512,"internally_reserved":0,"allocated":34799616,"data_stored":34487543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166888,"kb_used_data":55192,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94204952,"statfs":{"total":96636764160,"available":96465870848,"internally_reserved":0,"allocated":56516608,"data_stored":56203781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128304,"kb_used_data":38816,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243536,"statfs":{"total":96636764160,"available":96505380864,"internally_reserved":0,"allocated":39747584,"data_stored":39427853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55869440,"data_stored":55861108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39100416,"data_stored":39085180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34144256,"data_stored":34133752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25755648,"data_stored":25745176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:21:52.863 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.863 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.864 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.865 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.866 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.867 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.868 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.869 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.870 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-31T12:13:37.526092+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=37, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.871 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.872 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.873 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.874 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.875 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.876 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-08-31T12:13:44.624163+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=44, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.877 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.878 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.879 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.880 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.880 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.880 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.880 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.880 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.881 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.882 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.883 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:21:52.883 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-31T12:22:06.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:06.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:12.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:22:13.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.046+0000 7f1415200640 1 -- 172.21.15.164:0/2729364805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f4004d50 msgr2=0x7f13f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:13.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.046+0000 7f1415200640 1 --2- 172.21.15.164:0/2729364805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f4004d50 0x7f13f4005200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1408009e90 tx=0x7f140801d5d0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.046+0000 7f140e800640 1 -- 172.21.15.164:0/2729364805 reap_dead start 2024-08-31T12:22:13.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 -- 172.21.15.164:0/2729364805 shutdown_connections 2024-08-31T12:22:13.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 -- 172.21.15.164:0/2729364805 >> 172.21.15.164:0/2729364805 conn(0x7f141006dd40 msgr2=0x7f141006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:13.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 -- 172.21.15.164:0/2729364805 shutdown_connections 2024-08-31T12:22:13.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 -- 172.21.15.164:0/2729364805 wait complete. 2024-08-31T12:22:13.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 Processor -- start 2024-08-31T12:22:13.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 -- start start 2024-08-31T12:22:13.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13f4004d50 0x7f141014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:13.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14101558b0 0x7f14101f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:13.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.050+0000 7f1415200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:13.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f14100c95b0 con 0x7f14101e1ac0 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14100c92d0 con 0x7f14101558b0 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1410072e50 con 0x7f13f4004d50 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50000/0 (socket says 172.21.15.164:50000) 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 -- 172.21.15.164:0/3967234989 learned_addr learned my addr 172.21.15.164:0/3967234989 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140de00640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13f4004d50 0x7f141014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1405400640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14101558b0 0x7f14101f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 -- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13f4004d50 msgr2=0x7f141014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:13.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13f4004d50 0x7f141014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 -- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14101558b0 msgr2=0x7f14101f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14101558b0 0x7f14101f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 -- 172.21.15.164:0/3967234989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14101f3900 con 0x7f14101e1ac0 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f140e800640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f140801d040 tx=0x7f1408004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408009a90 con 0x7f14101e1ac0 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14080a9510 con 0x7f14101e1ac0 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080a9cf0 con 0x7f14101e1ac0 2024-08-31T12:22:13.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14101f0790 con 0x7f14101e1ac0 2024-08-31T12:22:13.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1410156d20 con 0x7f14101e1ac0 2024-08-31T12:22:13.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14101f0c90 con 0x7f14101e1ac0 2024-08-31T12:22:13.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.054+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f14080a7040 con 0x7f14101e1ac0 2024-08-31T12:22:13.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.058+0000 7f1406a00640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 0x7f13ec074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:13.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.058+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f140812de40 con 0x7f14101e1ac0 2024-08-31T12:22:13.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.058+0000 7f140de00640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 0x7f13ec074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:13.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.058+0000 7f140de00640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 0x7f13ec074600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1400006fd0 tx=0x7f1400006d10 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:13.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.062+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f14101f0c90 con 0x7f14101e1ac0 2024-08-31T12:22:13.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.226+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1410156000 con 0x7f13ec0720f0 2024-08-31T12:22:13.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.242+0000 7f1406a00640 1 -- 172.21.15.164:0/3967234989 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336307 (secure 0 0 0) 0x7f1400012560 con 0x7f13ec0720f0 2024-08-31T12:22:13.245 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:22:13.247 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 msgr2=0x7f13ec074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 0x7f13ec074600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1400006fd0 tx=0x7f1400006d10 comp rx=0 tx=0).stop 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 msgr2=0x7f14101e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f140801d040 tx=0x7f1408004f50 comp rx=0 tx=0).stop 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 shutdown_connections 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13ec0720f0 0x7f13ec074600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14101e1ac0 0x7f14101e1ed0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14101558b0 0x7f14101f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 --2- 172.21.15.164:0/3967234989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13f4004d50 0x7f141014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:13.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 >> 172.21.15.164:0/3967234989 conn(0x7f141006dd40 msgr2=0x7f1410151680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:13.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 shutdown_connections 2024-08-31T12:22:13.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:13.246+0000 7f1415200640 1 -- 172.21.15.164:0/3967234989 wait complete. 2024-08-31T12:22:13.267 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-08-31T12:22:12.769246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":145313023,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1776,"num_read_kb":531930,"num_write":15444,"num_write_kb":694543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11858,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21161,"ondisk_log_size":21161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1010408,"kb_used_data":288936,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":753964312,"statfs":{"total":773094113280,"available":772059455488,"internally_reserved":0,"allocated":295870464,"data_stored":293367430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":738643505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51799,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6858,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005895"},"pg_stats":[{"pgid":"2.1f","version":"56'62","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.717612+0000","last_change":"2024-08-31T12:21:54.717411+0000","last_active":"2024-08-31T12:21:54.717612+0000","last_peered":"2024-08-31T12:21:54.717612+0000","last_clean":"2024-08-31T12:21:54.717612+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:54.717612+0000","last_undegraded":"2024-08-31T12:21:54.717612+0000","last_fullsized":"2024-08-31T12:21:54.717612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'62","last_scrub_stamp":"2024-08-31T12:21:54.717135+0000","last_deep_scrub":"56'62","last_deep_scrub_stamp":"2024-08-31T12:21:54.717135+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.717135+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:13:02.117484+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"56'92","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.886912+0000","last_change":"2024-08-31T12:21:55.886912+0000","last_active":"2024-08-31T12:21:55.886912+0000","last_peered":"2024-08-31T12:21:55.886912+0000","last_clean":"2024-08-31T12:21:55.886912+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:55.886912+0000","last_undegraded":"2024-08-31T12:21:55.886912+0000","last_fullsized":"2024-08-31T12:21:55.886912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:55.886709+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:55.886709+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.886709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:14:36.282674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"56'369","reported_seq":2526,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.938131+0000","last_change":"2024-08-31T12:22:00.938131+0000","last_active":"2024-08-31T12:22:00.938131+0000","last_peered":"2024-08-31T12:22:00.938131+0000","last_clean":"2024-08-31T12:22:00.938131+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:22:00.938131+0000","last_undegraded":"2024-08-31T12:22:00.938131+0000","last_fullsized":"2024-08-31T12:22:00.938131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'369","last_scrub_stamp":"2024-08-31T12:22:00.937794+0000","last_deep_scrub":"56'369","last_deep_scrub_stamp":"2024-08-31T12:22:00.937794+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.937794+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:12:22.252144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":4130,"num_write":366,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"56'83","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.956541+0000","last_change":"2024-08-31T12:22:01.956541+0000","last_active":"2024-08-31T12:22:01.956541+0000","last_peered":"2024-08-31T12:22:01.956541+0000","last_clean":"2024-08-31T12:22:01.956541+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:22:01.956541+0000","last_undegraded":"2024-08-31T12:22:01.956541+0000","last_fullsized":"2024-08-31T12:22:01.956541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:01.956287+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:01.956287+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.956287+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:31.953743+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"56'87","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.958086+0000","last_change":"2024-08-31T12:22:00.957809+0000","last_active":"2024-08-31T12:22:00.958086+0000","last_peered":"2024-08-31T12:22:00.958086+0000","last_clean":"2024-08-31T12:22:00.958086+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:22:00.958086+0000","last_undegraded":"2024-08-31T12:22:00.958086+0000","last_fullsized":"2024-08-31T12:22:00.958086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:22:00.957506+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:22:00.957506+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.957506+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:25.382495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'352","reported_seq":2510,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.512509+0000","last_change":"2024-08-31T12:22:02.512509+0000","last_active":"2024-08-31T12:22:02.512509+0000","last_peered":"2024-08-31T12:22:02.512509+0000","last_clean":"2024-08-31T12:22:02.512509+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:22:02.512509+0000","last_undegraded":"2024-08-31T12:22:02.512509+0000","last_fullsized":"2024-08-31T12:22:02.512509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'352","last_scrub_stamp":"2024-08-31T12:22:02.512416+0000","last_deep_scrub":"56'352","last_deep_scrub_stamp":"2024-08-31T12:22:02.512416+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.512416+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:49:21.167999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":4129,"num_write":351,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"56'1943","reported_seq":2050,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.141295+0000","last_change":"2024-08-31T12:22:02.141295+0000","last_active":"2024-08-31T12:22:02.141295+0000","last_peered":"2024-08-31T12:22:02.141295+0000","last_clean":"2024-08-31T12:22:02.141295+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:22:02.141295+0000","last_undegraded":"2024-08-31T12:22:02.141295+0000","last_fullsized":"2024-08-31T12:22:02.141295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1943","last_scrub_stamp":"2024-08-31T12:22:02.141206+0000","last_deep_scrub":"56'1943","last_deep_scrub_stamp":"2024-08-31T12:22:02.141206+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.141206+0000","objects_scrubbed":4,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:50.708205+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":38903,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"56'92","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.598498+0000","last_change":"2024-08-31T12:21:56.598498+0000","last_active":"2024-08-31T12:21:56.598498+0000","last_peered":"2024-08-31T12:21:56.598498+0000","last_clean":"2024-08-31T12:21:56.598498+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:56.598498+0000","last_undegraded":"2024-08-31T12:21:56.598498+0000","last_fullsized":"2024-08-31T12:21:56.598498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:56.598399+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:56.598399+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.598399+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:22.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"56'369","reported_seq":2525,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.442451+0000","last_change":"2024-08-31T12:22:04.442451+0000","last_active":"2024-08-31T12:22:04.442451+0000","last_peered":"2024-08-31T12:22:04.442451+0000","last_clean":"2024-08-31T12:22:04.442451+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:22:04.442451+0000","last_undegraded":"2024-08-31T12:22:04.442451+0000","last_fullsized":"2024-08-31T12:22:04.442451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'369","last_scrub_stamp":"2024-08-31T12:22:04.442361+0000","last_deep_scrub":"56'369","last_deep_scrub_stamp":"2024-08-31T12:22:04.442361+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.442361+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:30.447760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":368,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"56'51","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.082811+0000","last_change":"2024-08-31T12:21:55.082811+0000","last_active":"2024-08-31T12:21:55.082811+0000","last_peered":"2024-08-31T12:21:55.082811+0000","last_clean":"2024-08-31T12:21:55.082811+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:55.082811+0000","last_undegraded":"2024-08-31T12:21:55.082811+0000","last_fullsized":"2024-08-31T12:21:55.082811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'51","last_scrub_stamp":"2024-08-31T12:21:55.082728+0000","last_deep_scrub":"56'51","last_deep_scrub_stamp":"2024-08-31T12:21:55.082728+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.082728+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:58.433488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"56'88","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.938683+0000","last_change":"2024-08-31T12:22:07.938683+0000","last_active":"2024-08-31T12:22:07.938683+0000","last_peered":"2024-08-31T12:22:07.938683+0000","last_clean":"2024-08-31T12:22:07.938683+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:22:07.938683+0000","last_undegraded":"2024-08-31T12:22:07.938683+0000","last_fullsized":"2024-08-31T12:22:07.938683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:22:07.938601+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:22:07.938601+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.938601+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:15.196547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"56'334","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.468390+0000","last_change":"2024-08-31T12:22:03.468390+0000","last_active":"2024-08-31T12:22:03.468390+0000","last_peered":"2024-08-31T12:22:03.468390+0000","last_clean":"2024-08-31T12:22:03.468390+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:22:03.468390+0000","last_undegraded":"2024-08-31T12:22:03.468390+0000","last_fullsized":"2024-08-31T12:22:03.468390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'334","last_scrub_stamp":"2024-08-31T12:22:03.468285+0000","last_deep_scrub":"56'334","last_deep_scrub_stamp":"2024-08-31T12:22:03.468285+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.468285+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:29.945194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":334,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"56'88","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.887581+0000","last_change":"2024-08-31T12:21:59.887581+0000","last_active":"2024-08-31T12:21:59.887581+0000","last_peered":"2024-08-31T12:21:59.887581+0000","last_clean":"2024-08-31T12:21:59.887581+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:59.887581+0000","last_undegraded":"2024-08-31T12:21:59.887581+0000","last_fullsized":"2024-08-31T12:21:59.887581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:21:59.887465+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:21:59.887465+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.887465+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:22.769942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"56'89","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.930476+0000","last_change":"2024-08-31T12:21:54.930476+0000","last_active":"2024-08-31T12:21:54.930476+0000","last_peered":"2024-08-31T12:21:54.930476+0000","last_clean":"2024-08-31T12:21:54.930476+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:54.930476+0000","last_undegraded":"2024-08-31T12:21:54.930476+0000","last_fullsized":"2024-08-31T12:21:54.930476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:54.930376+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:54.930376+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.930376+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:50.056222+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"56'339","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.012744+0000","last_change":"2024-08-31T12:22:07.012744+0000","last_active":"2024-08-31T12:22:07.012744+0000","last_peered":"2024-08-31T12:22:07.012744+0000","last_clean":"2024-08-31T12:22:07.012744+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:22:07.012744+0000","last_undegraded":"2024-08-31T12:22:07.012744+0000","last_fullsized":"2024-08-31T12:22:07.012744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'339","last_scrub_stamp":"2024-08-31T12:22:07.012655+0000","last_deep_scrub":"56'339","last_deep_scrub_stamp":"2024-08-31T12:22:07.012655+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.012655+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:18:32.622736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":4130,"num_write":338,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"56'89","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.857840+0000","last_change":"2024-08-31T12:21:56.857840+0000","last_active":"2024-08-31T12:21:56.857840+0000","last_peered":"2024-08-31T12:21:56.857840+0000","last_clean":"2024-08-31T12:21:56.857840+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:56.857840+0000","last_undegraded":"2024-08-31T12:21:56.857840+0000","last_fullsized":"2024-08-31T12:21:56.857840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:56.857648+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:56.857648+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.857648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:27:23.716810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"56'24","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.607551+0000","last_change":"2024-08-31T12:21:52.607551+0000","last_active":"2024-08-31T12:21:52.607551+0000","last_peered":"2024-08-31T12:21:52.607551+0000","last_clean":"2024-08-31T12:21:52.607551+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:52.607551+0000","last_undegraded":"2024-08-31T12:21:52.607551+0000","last_fullsized":"2024-08-31T12:21:52.607551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-08-31T12:21:52.607289+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-08-31T12:21:52.607289+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.607289+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:14:24.910359+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"56'363","reported_seq":2515,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.985422+0000","last_change":"2024-08-31T12:22:04.985422+0000","last_active":"2024-08-31T12:22:04.985422+0000","last_peered":"2024-08-31T12:22:04.985422+0000","last_clean":"2024-08-31T12:22:04.985422+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:22:04.985422+0000","last_undegraded":"2024-08-31T12:22:04.985422+0000","last_fullsized":"2024-08-31T12:22:04.985422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'363","last_scrub_stamp":"2024-08-31T12:22:04.985327+0000","last_deep_scrub":"56'363","last_deep_scrub_stamp":"2024-08-31T12:22:04.985327+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.985327+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:58:04.436708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":4130,"num_write":360,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'93","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.815301+0000","last_change":"2024-08-31T12:22:00.815301+0000","last_active":"2024-08-31T12:22:00.815301+0000","last_peered":"2024-08-31T12:22:00.815301+0000","last_clean":"2024-08-31T12:22:00.815301+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:22:00.815301+0000","last_undegraded":"2024-08-31T12:22:00.815301+0000","last_fullsized":"2024-08-31T12:22:00.815301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:00.814984+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:00.814984+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.814984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:51.666514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'96","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.726330+0000","last_change":"2024-08-31T12:21:52.726168+0000","last_active":"2024-08-31T12:21:52.726330+0000","last_peered":"2024-08-31T12:21:52.726330+0000","last_clean":"2024-08-31T12:21:52.726330+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:21:52.726330+0000","last_undegraded":"2024-08-31T12:21:52.726330+0000","last_fullsized":"2024-08-31T12:21:52.726330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'95","last_scrub_stamp":"2024-08-31T12:21:52.725978+0000","last_deep_scrub":"56'95","last_deep_scrub_stamp":"2024-08-31T12:21:52.725978+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.725978+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:07:31.496201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":92,"num_write_kb":1564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"56'336","reported_seq":2495,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.893561+0000","last_change":"2024-08-31T12:21:57.893561+0000","last_active":"2024-08-31T12:21:57.893561+0000","last_peered":"2024-08-31T12:21:57.893561+0000","last_clean":"2024-08-31T12:21:57.893561+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:57.893561+0000","last_undegraded":"2024-08-31T12:21:57.893561+0000","last_fullsized":"2024-08-31T12:21:57.893561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'336","last_scrub_stamp":"2024-08-31T12:21:57.893365+0000","last_deep_scrub":"56'336","last_deep_scrub_stamp":"2024-08-31T12:21:57.893365+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.893365+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:18.618446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":8232,"num_write":332,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'94","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.911534+0000","last_change":"2024-08-31T12:21:55.911534+0000","last_active":"2024-08-31T12:21:55.911534+0000","last_peered":"2024-08-31T12:21:55.911534+0000","last_clean":"2024-08-31T12:21:55.911534+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:55.911534+0000","last_undegraded":"2024-08-31T12:21:55.911534+0000","last_fullsized":"2024-08-31T12:21:55.911534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'94","last_scrub_stamp":"2024-08-31T12:21:55.911444+0000","last_deep_scrub":"56'94","last_deep_scrub_stamp":"2024-08-31T12:21:55.911444+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.911444+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:18.245824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"56'9","reported_seq":103,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.089124+0000","last_change":"2024-08-31T12:21:50.089124+0000","last_active":"2024-08-31T12:21:50.089124+0000","last_peered":"2024-08-31T12:21:50.089124+0000","last_clean":"2024-08-31T12:21:50.089124+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:50.089124+0000","last_undegraded":"2024-08-31T12:21:50.089124+0000","last_fullsized":"2024-08-31T12:21:50.089124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.089039+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:59.686158+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"56'286","reported_seq":2442,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.453299+0000","last_change":"2024-08-31T12:21:58.453299+0000","last_active":"2024-08-31T12:21:58.453299+0000","last_peered":"2024-08-31T12:21:58.453299+0000","last_clean":"2024-08-31T12:21:58.453299+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:58.453299+0000","last_undegraded":"2024-08-31T12:21:58.453299+0000","last_fullsized":"2024-08-31T12:21:58.453299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'286","last_scrub_stamp":"2024-08-31T12:21:58.453210+0000","last_deep_scrub":"56'286","last_deep_scrub_stamp":"2024-08-31T12:21:58.453210+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.453210+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:19.834451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":4132,"num_write":284,"num_write_kb":20569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"56'93","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.757939+0000","last_change":"2024-08-31T12:21:56.757939+0000","last_active":"2024-08-31T12:21:56.757939+0000","last_peered":"2024-08-31T12:21:56.757939+0000","last_clean":"2024-08-31T12:21:56.757939+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:56.757939+0000","last_undegraded":"2024-08-31T12:21:56.757939+0000","last_fullsized":"2024-08-31T12:21:56.757939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:21:56.757738+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:21:56.757738+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.757738+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:42.279618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'10","reported_seq":106,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.864893+0000","last_change":"2024-08-31T12:21:52.864893+0000","last_active":"2024-08-31T12:21:52.864893+0000","last_peered":"2024-08-31T12:21:52.864893+0000","last_clean":"2024-08-31T12:21:52.864893+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:52.864893+0000","last_undegraded":"2024-08-31T12:21:52.864893+0000","last_fullsized":"2024-08-31T12:21:52.864893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-08-31T12:21:52.864819+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-08-31T12:21:52.864819+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.864819+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:28:50.885753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'362","reported_seq":2512,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.432763+0000","last_change":"2024-08-31T12:21:59.432694+0000","last_active":"2024-08-31T12:21:59.432763+0000","last_peered":"2024-08-31T12:21:59.432763+0000","last_clean":"2024-08-31T12:21:59.432763+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:59.432763+0000","last_undegraded":"2024-08-31T12:21:59.432763+0000","last_fullsized":"2024-08-31T12:21:59.432763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'362","last_scrub_stamp":"2024-08-31T12:21:59.432592+0000","last_deep_scrub":"56'362","last_deep_scrub_stamp":"2024-08-31T12:21:59.432592+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.432592+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:01.624681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":28,"num_write":360,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"56'88","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.771055+0000","last_change":"2024-08-31T12:21:58.771055+0000","last_active":"2024-08-31T12:21:58.771055+0000","last_peered":"2024-08-31T12:21:58.771055+0000","last_clean":"2024-08-31T12:21:58.771055+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:58.771055+0000","last_undegraded":"2024-08-31T12:21:58.771055+0000","last_fullsized":"2024-08-31T12:21:58.771055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:21:58.770867+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:21:58.770867+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.770867+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:12:20.157465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'170","reported_seq":268,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.697023+0000","last_change":"2024-08-31T12:21:51.697023+0000","last_active":"2024-08-31T12:21:51.697023+0000","last_peered":"2024-08-31T12:21:51.697023+0000","last_clean":"2024-08-31T12:21:51.697023+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:51.697023+0000","last_undegraded":"2024-08-31T12:21:51.697023+0000","last_fullsized":"2024-08-31T12:21:51.697023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'170","last_scrub_stamp":"2024-08-31T12:21:51.696710+0000","last_deep_scrub":"56'170","last_deep_scrub_stamp":"2024-08-31T12:21:51.696710+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.696710+0000","objects_scrubbed":1,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:25.908125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":414,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'358","reported_seq":2524,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.786323+0000","last_change":"2024-08-31T12:22:03.786323+0000","last_active":"2024-08-31T12:22:03.786323+0000","last_peered":"2024-08-31T12:22:03.786323+0000","last_clean":"2024-08-31T12:22:03.786323+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:22:03.786323+0000","last_undegraded":"2024-08-31T12:22:03.786323+0000","last_fullsized":"2024-08-31T12:22:03.786323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'358","last_scrub_stamp":"2024-08-31T12:22:03.786128+0000","last_deep_scrub":"56'358","last_deep_scrub_stamp":"2024-08-31T12:22:03.786128+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.786128+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:42:34.748565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":356,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"56'90","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.512266+0000","last_change":"2024-08-31T12:21:56.512092+0000","last_active":"2024-08-31T12:21:56.512266+0000","last_peered":"2024-08-31T12:21:56.512266+0000","last_clean":"2024-08-31T12:21:56.512266+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:56.512266+0000","last_undegraded":"2024-08-31T12:21:56.512266+0000","last_fullsized":"2024-08-31T12:21:56.512266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:56.511890+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:56.511890+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.511890+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:25.651388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"56'24","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.965638+0000","last_change":"2024-08-31T12:21:56.965564+0000","last_active":"2024-08-31T12:21:56.965638+0000","last_peered":"2024-08-31T12:21:56.965638+0000","last_clean":"2024-08-31T12:21:56.965638+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:56.965638+0000","last_undegraded":"2024-08-31T12:21:56.965638+0000","last_fullsized":"2024-08-31T12:21:56.965638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-08-31T12:21:56.965444+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-08-31T12:21:56.965444+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.965444+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:51:54.400966+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'374","reported_seq":2528,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.656202+0000","last_change":"2024-08-31T12:22:04.656032+0000","last_active":"2024-08-31T12:22:04.656202+0000","last_peered":"2024-08-31T12:22:04.656202+0000","last_clean":"2024-08-31T12:22:04.656202+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:22:04.656202+0000","last_undegraded":"2024-08-31T12:22:04.656202+0000","last_fullsized":"2024-08-31T12:22:04.656202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'374","last_scrub_stamp":"2024-08-31T12:22:04.655838+0000","last_deep_scrub":"56'374","last_deep_scrub_stamp":"2024-08-31T12:22:04.655838+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.655838+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:56:22.888721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":32,"num_write":374,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"56'83","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.500666+0000","last_change":"2024-08-31T12:21:51.500560+0000","last_active":"2024-08-31T12:21:51.500666+0000","last_peered":"2024-08-31T12:21:51.500666+0000","last_clean":"2024-08-31T12:21:51.500666+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:51.500666+0000","last_undegraded":"2024-08-31T12:21:51.500666+0000","last_fullsized":"2024-08-31T12:21:51.500666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:21:51.500469+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:21:51.500469+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.500469+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:29:27.720371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'3","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.915882+0000","last_change":"2024-08-31T12:21:51.915704+0000","last_active":"2024-08-31T12:21:51.915882+0000","last_peered":"2024-08-31T12:21:51.915882+0000","last_clean":"2024-08-31T12:21:51.915882+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:51.915882+0000","last_undegraded":"2024-08-31T12:21:51.915882+0000","last_fullsized":"2024-08-31T12:21:51.915882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-08-31T12:21:51.915487+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-08-31T12:21:51.915487+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.915487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:42.465333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'353","reported_seq":2505,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.588373+0000","last_change":"2024-08-31T12:22:02.588076+0000","last_active":"2024-08-31T12:22:02.588373+0000","last_peered":"2024-08-31T12:22:02.588373+0000","last_clean":"2024-08-31T12:22:02.588373+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:22:02.588373+0000","last_undegraded":"2024-08-31T12:22:02.588373+0000","last_fullsized":"2024-08-31T12:22:02.588373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'353","last_scrub_stamp":"2024-08-31T12:22:02.587749+0000","last_deep_scrub":"56'353","last_deep_scrub_stamp":"2024-08-31T12:22:02.587749+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.587749+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:45.386162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":34,"num_write":352,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"56'97","reported_seq":2219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.108644+0000","last_change":"2024-08-31T12:21:52.108591+0000","last_active":"2024-08-31T12:21:52.108644+0000","last_peered":"2024-08-31T12:21:52.108644+0000","last_clean":"2024-08-31T12:21:52.108644+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:52.108644+0000","last_undegraded":"2024-08-31T12:21:52.108644+0000","last_fullsized":"2024-08-31T12:21:52.108644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:21:52.108515+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:21:52.108515+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.108515+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:42:55.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"56'169","reported_seq":267,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.850092+0000","last_change":"2024-08-31T12:21:50.850019+0000","last_active":"2024-08-31T12:21:50.850092+0000","last_peered":"2024-08-31T12:21:50.850092+0000","last_clean":"2024-08-31T12:21:50.850092+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:50.850092+0000","last_undegraded":"2024-08-31T12:21:50.850092+0000","last_fullsized":"2024-08-31T12:21:50.850092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.849945+0000","objects_scrubbed":2,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:49.571172+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'320","reported_seq":2466,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.622588+0000","last_change":"2024-08-31T12:22:03.622417+0000","last_active":"2024-08-31T12:22:03.622588+0000","last_peered":"2024-08-31T12:22:03.622588+0000","last_clean":"2024-08-31T12:22:03.622588+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:22:03.622588+0000","last_undegraded":"2024-08-31T12:22:03.622588+0000","last_fullsized":"2024-08-31T12:22:03.622588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'320","last_scrub_stamp":"2024-08-31T12:22:03.622216+0000","last_deep_scrub":"56'320","last_deep_scrub_stamp":"2024-08-31T12:22:03.622216+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.622216+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:07:46.585770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3300,"num_write":320,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"56'83","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.870741+0000","last_change":"2024-08-31T12:21:54.870741+0000","last_active":"2024-08-31T12:21:54.870741+0000","last_peered":"2024-08-31T12:21:54.870741+0000","last_clean":"2024-08-31T12:21:54.870741+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:54.870741+0000","last_undegraded":"2024-08-31T12:21:54.870741+0000","last_fullsized":"2024-08-31T12:21:54.870741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:21:54.870546+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:21:54.870546+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.870546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:52.525819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"56'146","reported_seq":384,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.899450+0000","last_change":"2024-08-31T12:21:52.899251+0000","last_active":"2024-08-31T12:21:52.899450+0000","last_peered":"2024-08-31T12:21:52.899450+0000","last_clean":"2024-08-31T12:21:52.899450+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:52.899450+0000","last_undegraded":"2024-08-31T12:21:52.899450+0000","last_fullsized":"2024-08-31T12:21:52.899450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'146","last_scrub_stamp":"2024-08-31T12:21:52.898947+0000","last_deep_scrub":"56'146","last_deep_scrub_stamp":"2024-08-31T12:21:52.898947+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.898947+0000","objects_scrubbed":1,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:34.531866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":579228,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":146,"num_read_kb":661,"num_write":141,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"56'331","reported_seq":2483,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.651987+0000","last_change":"2024-08-31T12:22:05.651987+0000","last_active":"2024-08-31T12:22:05.651987+0000","last_peered":"2024-08-31T12:22:05.651987+0000","last_clean":"2024-08-31T12:22:05.651987+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:22:05.651987+0000","last_undegraded":"2024-08-31T12:22:05.651987+0000","last_fullsized":"2024-08-31T12:22:05.651987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'331","last_scrub_stamp":"2024-08-31T12:22:05.651778+0000","last_deep_scrub":"56'331","last_deep_scrub_stamp":"2024-08-31T12:22:05.651778+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.651778+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:29.289146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":330,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"56'82","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.523993+0000","last_change":"2024-08-31T12:21:55.523820+0000","last_active":"2024-08-31T12:21:55.523993+0000","last_peered":"2024-08-31T12:21:55.523993+0000","last_clean":"2024-08-31T12:21:55.523993+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:55.523993+0000","last_undegraded":"2024-08-31T12:21:55.523993+0000","last_fullsized":"2024-08-31T12:21:55.523993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'82","last_scrub_stamp":"2024-08-31T12:21:55.523624+0000","last_deep_scrub":"56'82","last_deep_scrub_stamp":"2024-08-31T12:21:55.523624+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.523624+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:40.887584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'103","reported_seq":203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.969002+0000","last_change":"2024-08-31T12:22:01.969002+0000","last_active":"2024-08-31T12:22:01.969002+0000","last_peered":"2024-08-31T12:22:01.969002+0000","last_clean":"2024-08-31T12:22:01.969002+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:22:01.969002+0000","last_undegraded":"2024-08-31T12:22:01.969002+0000","last_fullsized":"2024-08-31T12:22:01.969002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'103","last_scrub_stamp":"2024-08-31T12:22:01.968903+0000","last_deep_scrub":"56'103","last_deep_scrub_stamp":"2024-08-31T12:22:01.968903+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.968903+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:17.530329+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2525,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.874348+0000","last_change":"2024-08-31T12:22:07.874348+0000","last_active":"2024-08-31T12:22:07.874348+0000","last_peered":"2024-08-31T12:22:07.874348+0000","last_clean":"2024-08-31T12:22:07.874348+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:22:07.874348+0000","last_undegraded":"2024-08-31T12:22:07.874348+0000","last_fullsized":"2024-08-31T12:22:07.874348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'365","last_scrub_stamp":"2024-08-31T12:22:07.874105+0000","last_deep_scrub":"44'365","last_deep_scrub_stamp":"2024-08-31T12:22:07.874105+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.874105+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:55.138503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"56'91","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.778087+0000","last_change":"2024-08-31T12:21:57.777825+0000","last_active":"2024-08-31T12:21:57.778087+0000","last_peered":"2024-08-31T12:21:57.778087+0000","last_clean":"2024-08-31T12:21:57.778087+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:57.778087+0000","last_undegraded":"2024-08-31T12:21:57.778087+0000","last_fullsized":"2024-08-31T12:21:57.778087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'91","last_scrub_stamp":"2024-08-31T12:21:57.777575+0000","last_deep_scrub":"56'91","last_deep_scrub_stamp":"2024-08-31T12:21:57.777575+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.777575+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:25.267522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.857163+0000","last_change":"2024-08-31T12:21:51.857090+0000","last_active":"2024-08-31T12:21:51.857163+0000","last_peered":"2024-08-31T12:21:51.857163+0000","last_clean":"2024-08-31T12:21:51.857163+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:51.857163+0000","last_undegraded":"2024-08-31T12:21:51.857163+0000","last_fullsized":"2024-08-31T12:21:51.857163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-08-31T12:21:51.857016+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-08-31T12:21:51.857016+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.857016+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:28:21.259871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"56'74","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.599874+0000","last_change":"2024-08-31T12:21:52.599874+0000","last_active":"2024-08-31T12:21:52.599874+0000","last_peered":"2024-08-31T12:21:52.599874+0000","last_clean":"2024-08-31T12:21:52.599874+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:52.599874+0000","last_undegraded":"2024-08-31T12:21:52.599874+0000","last_fullsized":"2024-08-31T12:21:52.599874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74","last_scrub_stamp":"2024-08-31T12:21:52.599797+0000","last_deep_scrub":"56'74","last_deep_scrub_stamp":"2024-08-31T12:21:52.599797+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.599797+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:06.404675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'299","reported_seq":2449,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:09.959567+0000","last_change":"2024-08-31T12:22:09.959469+0000","last_active":"2024-08-31T12:22:09.959567+0000","last_peered":"2024-08-31T12:22:09.959567+0000","last_clean":"2024-08-31T12:22:09.959567+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:22:09.959567+0000","last_undegraded":"2024-08-31T12:22:09.959567+0000","last_fullsized":"2024-08-31T12:22:09.959567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'299","last_scrub_stamp":"2024-08-31T12:22:09.959313+0000","last_deep_scrub":"56'299","last_deep_scrub_stamp":"2024-08-31T12:22:09.959313+0000","last_clean_scrub_stamp":"2024-08-31T12:22:09.959313+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:10:32.460754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":298,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"56'93","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.932381+0000","last_change":"2024-08-31T12:21:58.932381+0000","last_active":"2024-08-31T12:21:58.932381+0000","last_peered":"2024-08-31T12:21:58.932381+0000","last_clean":"2024-08-31T12:21:58.932381+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:58.932381+0000","last_undegraded":"2024-08-31T12:21:58.932381+0000","last_fullsized":"2024-08-31T12:21:58.932381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:21:58.932299+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:21:58.932299+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.932299+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:10.950683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.589285+0000","last_change":"2024-08-31T12:21:53.589285+0000","last_active":"2024-08-31T12:21:53.589285+0000","last_peered":"2024-08-31T12:21:53.589285+0000","last_clean":"2024-08-31T12:21:53.589285+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:53.589285+0000","last_undegraded":"2024-08-31T12:21:53.589285+0000","last_fullsized":"2024-08-31T12:21:53.589285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2024-08-31T12:21:53.588909+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2024-08-31T12:21:53.588909+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.588909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:13:33.403839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'346","reported_seq":2494,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.467548+0000","last_change":"2024-08-31T12:22:00.467548+0000","last_active":"2024-08-31T12:22:00.467548+0000","last_peered":"2024-08-31T12:22:00.467548+0000","last_clean":"2024-08-31T12:22:00.467548+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:22:00.467548+0000","last_undegraded":"2024-08-31T12:22:00.467548+0000","last_fullsized":"2024-08-31T12:22:00.467548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'346","last_scrub_stamp":"2024-08-31T12:22:00.467431+0000","last_deep_scrub":"56'346","last_deep_scrub_stamp":"2024-08-31T12:22:00.467431+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.467431+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:09:57.989807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":344,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"56'97","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.090781+0000","last_change":"2024-08-31T12:21:57.090781+0000","last_active":"2024-08-31T12:21:57.090781+0000","last_peered":"2024-08-31T12:21:57.090781+0000","last_clean":"2024-08-31T12:21:57.090781+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:57.090781+0000","last_undegraded":"2024-08-31T12:21:57.090781+0000","last_fullsized":"2024-08-31T12:21:57.090781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:21:57.090678+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:21:57.090678+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.090678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:43:15.144725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"56'23","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.910223+0000","last_change":"2024-08-31T12:21:52.910223+0000","last_active":"2024-08-31T12:21:52.910223+0000","last_peered":"2024-08-31T12:21:52.910223+0000","last_clean":"2024-08-31T12:21:52.910223+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:52.910223+0000","last_undegraded":"2024-08-31T12:21:52.910223+0000","last_fullsized":"2024-08-31T12:21:52.910223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-08-31T12:21:52.909962+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-08-31T12:21:52.909962+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.909962+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:22.287929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'324","reported_seq":2479,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:08.903046+0000","last_change":"2024-08-31T12:22:08.903046+0000","last_active":"2024-08-31T12:22:08.903046+0000","last_peered":"2024-08-31T12:22:08.903046+0000","last_clean":"2024-08-31T12:22:08.903046+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:22:08.903046+0000","last_undegraded":"2024-08-31T12:22:08.903046+0000","last_fullsized":"2024-08-31T12:22:08.903046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'324","last_scrub_stamp":"2024-08-31T12:22:08.902839+0000","last_deep_scrub":"56'324","last_deep_scrub_stamp":"2024-08-31T12:22:08.902839+0000","last_clean_scrub_stamp":"2024-08-31T12:22:08.902839+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:10.806727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":36,"num_write":324,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"56'87","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.105633+0000","last_change":"2024-08-31T12:21:59.105633+0000","last_active":"2024-08-31T12:21:59.105633+0000","last_peered":"2024-08-31T12:21:59.105633+0000","last_clean":"2024-08-31T12:21:59.105633+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:59.105633+0000","last_undegraded":"2024-08-31T12:21:59.105633+0000","last_fullsized":"2024-08-31T12:21:59.105633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:21:59.105523+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:21:59.105523+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.105523+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:26.797289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"56'109","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.702818+0000","last_change":"2024-08-31T12:21:53.702818+0000","last_active":"2024-08-31T12:21:53.702818+0000","last_peered":"2024-08-31T12:21:53.702818+0000","last_clean":"2024-08-31T12:21:53.702818+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:53.702818+0000","last_undegraded":"2024-08-31T12:21:53.702818+0000","last_fullsized":"2024-08-31T12:21:53.702818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:53.702608+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:53.702608+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.702608+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:53.145552+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'346","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.904031+0000","last_change":"2024-08-31T12:19:51.190295+0000","last_active":"2024-08-31T12:21:42.904031+0000","last_peered":"2024-08-31T12:21:42.904031+0000","last_clean":"2024-08-31T12:21:42.904031+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:21:42.904031+0000","last_undegraded":"2024-08-31T12:21:42.904031+0000","last_fullsized":"2024-08-31T12:21:42.904031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:44.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":32,"num_write":346,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"56'65","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.475443+0000","last_change":"2024-08-31T12:21:50.475443+0000","last_active":"2024-08-31T12:21:50.475443+0000","last_peered":"2024-08-31T12:21:50.475443+0000","last_clean":"2024-08-31T12:21:50.475443+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:50.475443+0000","last_undegraded":"2024-08-31T12:21:50.475443+0000","last_fullsized":"2024-08-31T12:21:50.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'65","last_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_deep_scrub":"56'65","last_deep_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.475366+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:32.691010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"56'21","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.094777+0000","last_change":"2024-08-31T12:21:53.094777+0000","last_active":"2024-08-31T12:21:53.094777+0000","last_peered":"2024-08-31T12:21:53.094777+0000","last_clean":"2024-08-31T12:21:53.094777+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:53.094777+0000","last_undegraded":"2024-08-31T12:21:53.094777+0000","last_fullsized":"2024-08-31T12:21:53.094777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-08-31T12:21:53.094707+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-08-31T12:21:53.094707+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.094707+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:50.336119+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'366","reported_seq":2530,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.589203+0000","last_change":"2024-08-31T12:21:54.589203+0000","last_active":"2024-08-31T12:21:54.589203+0000","last_peered":"2024-08-31T12:21:54.589203+0000","last_clean":"2024-08-31T12:21:54.589203+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:54.589203+0000","last_undegraded":"2024-08-31T12:21:54.589203+0000","last_fullsized":"2024-08-31T12:21:54.589203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-08-31T12:21:54.589106+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-08-31T12:21:54.589106+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.589106+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:11.082146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":4137,"num_write":364,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"56'93","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.955789+0000","last_change":"2024-08-31T12:22:02.955789+0000","last_active":"2024-08-31T12:22:02.955789+0000","last_peered":"2024-08-31T12:22:02.955789+0000","last_clean":"2024-08-31T12:22:02.955789+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:22:02.955789+0000","last_undegraded":"2024-08-31T12:22:02.955789+0000","last_fullsized":"2024-08-31T12:22:02.955789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:02.955699+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:02.955699+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.955699+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:02:40.565748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"56'304","reported_seq":423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.753749+0000","last_change":"2024-08-31T12:21:55.753749+0000","last_active":"2024-08-31T12:21:55.753749+0000","last_peered":"2024-08-31T12:21:55.753749+0000","last_clean":"2024-08-31T12:21:55.753749+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:55.753749+0000","last_undegraded":"2024-08-31T12:21:55.753749+0000","last_fullsized":"2024-08-31T12:21:55.753749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'304","last_scrub_stamp":"2024-08-31T12:21:55.753394+0000","last_deep_scrub":"56'304","last_deep_scrub_stamp":"2024-08-31T12:21:55.753394+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.753394+0000","objects_scrubbed":6,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:33:14.734406+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2510,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:09.855930+0000","last_change":"2024-08-31T12:22:09.855930+0000","last_active":"2024-08-31T12:22:09.855930+0000","last_peered":"2024-08-31T12:22:09.855930+0000","last_clean":"2024-08-31T12:22:09.855930+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:22:09.855930+0000","last_undegraded":"2024-08-31T12:22:09.855930+0000","last_fullsized":"2024-08-31T12:22:09.855930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'358","last_scrub_stamp":"2024-08-31T12:22:09.855594+0000","last_deep_scrub":"43'358","last_deep_scrub_stamp":"2024-08-31T12:22:09.855594+0000","last_clean_scrub_stamp":"2024-08-31T12:22:09.855594+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:49.502535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"56'90","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.568257+0000","last_change":"2024-08-31T12:21:49.568257+0000","last_active":"2024-08-31T12:21:49.568257+0000","last_peered":"2024-08-31T12:21:49.568257+0000","last_clean":"2024-08-31T12:21:49.568257+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:49.568257+0000","last_undegraded":"2024-08-31T12:21:49.568257+0000","last_fullsized":"2024-08-31T12:21:49.568257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.568128+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:34:33.999379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"56'3","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.112961+0000","last_change":"2024-08-31T12:21:51.112961+0000","last_active":"2024-08-31T12:21:51.112961+0000","last_peered":"2024-08-31T12:21:51.112961+0000","last_clean":"2024-08-31T12:21:51.112961+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:51.112961+0000","last_undegraded":"2024-08-31T12:21:51.112961+0000","last_fullsized":"2024-08-31T12:21:51.112961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-08-31T12:21:51.112861+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-08-31T12:21:51.112861+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.112861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:26.979144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'320","reported_seq":2472,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.966024+0000","last_change":"2024-08-31T12:19:51.076307+0000","last_active":"2024-08-31T12:21:42.966024+0000","last_peered":"2024-08-31T12:21:42.966024+0000","last_clean":"2024-08-31T12:21:42.966024+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:21:42.966024+0000","last_undegraded":"2024-08-31T12:21:42.966024+0000","last_fullsized":"2024-08-31T12:21:42.966024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:59.114734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":4133,"num_write":318,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"56'101","reported_seq":2228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.932046+0000","last_change":"2024-08-31T12:22:03.932046+0000","last_active":"2024-08-31T12:22:03.932046+0000","last_peered":"2024-08-31T12:22:03.932046+0000","last_clean":"2024-08-31T12:22:03.932046+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:22:03.932046+0000","last_undegraded":"2024-08-31T12:22:03.932046+0000","last_fullsized":"2024-08-31T12:22:03.932046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'101","last_scrub_stamp":"2024-08-31T12:22:03.931958+0000","last_deep_scrub":"56'101","last_deep_scrub_stamp":"2024-08-31T12:22:03.931958+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.931958+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:05.817013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.891661+0000","last_change":"2024-08-31T12:21:53.891661+0000","last_active":"2024-08-31T12:21:53.891661+0000","last_peered":"2024-08-31T12:21:53.891661+0000","last_clean":"2024-08-31T12:21:53.891661+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:53.891661+0000","last_undegraded":"2024-08-31T12:21:53.891661+0000","last_fullsized":"2024-08-31T12:21:53.891661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:21:53.891567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:21:53.891567+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.891567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:48:27.669347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'304","reported_seq":2448,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.639992+0000","last_change":"2024-08-31T12:22:06.639992+0000","last_active":"2024-08-31T12:22:06.639992+0000","last_peered":"2024-08-31T12:22:06.639992+0000","last_clean":"2024-08-31T12:22:06.639992+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:22:06.639992+0000","last_undegraded":"2024-08-31T12:22:06.639992+0000","last_fullsized":"2024-08-31T12:22:06.639992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'304","last_scrub_stamp":"2024-08-31T12:22:06.639668+0000","last_deep_scrub":"56'304","last_deep_scrub_stamp":"2024-08-31T12:22:06.639668+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.639668+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:16:12.935828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":302,"num_write_kb":32911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"56'87","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.542185+0000","last_change":"2024-08-31T12:21:57.542185+0000","last_active":"2024-08-31T12:21:57.542185+0000","last_peered":"2024-08-31T12:21:57.542185+0000","last_clean":"2024-08-31T12:21:57.542185+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:57.542185+0000","last_undegraded":"2024-08-31T12:21:57.542185+0000","last_fullsized":"2024-08-31T12:21:57.542185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:21:57.541995+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:21:57.541995+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.541995+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:04.441090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"56'132","reported_seq":238,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.922647+0000","last_change":"2024-08-31T12:21:54.922647+0000","last_active":"2024-08-31T12:21:54.922647+0000","last_peered":"2024-08-31T12:21:54.922647+0000","last_clean":"2024-08-31T12:21:54.922647+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:54.922647+0000","last_undegraded":"2024-08-31T12:21:54.922647+0000","last_fullsized":"2024-08-31T12:21:54.922647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'132","last_scrub_stamp":"2024-08-31T12:21:54.922391+0000","last_deep_scrub":"56'132","last_deep_scrub_stamp":"2024-08-31T12:21:54.922391+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.922391+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:39.128053+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":28704,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'333","reported_seq":2481,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.978190+0000","last_change":"2024-08-31T12:19:51.189127+0000","last_active":"2024-08-31T12:21:42.978190+0000","last_peered":"2024-08-31T12:21:42.978190+0000","last_clean":"2024-08-31T12:21:42.978190+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:21:42.978190+0000","last_undegraded":"2024-08-31T12:21:42.978190+0000","last_fullsized":"2024-08-31T12:21:42.978190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:53.515083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":332,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"56'83","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.032328+0000","last_change":"2024-08-31T12:22:04.032328+0000","last_active":"2024-08-31T12:22:04.032328+0000","last_peered":"2024-08-31T12:22:04.032328+0000","last_clean":"2024-08-31T12:22:04.032328+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:22:04.032328+0000","last_undegraded":"2024-08-31T12:22:04.032328+0000","last_fullsized":"2024-08-31T12:22:04.032328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:04.032240+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:04.032240+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.032240+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:33.130041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'177","reported_seq":292,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.509984+0000","last_change":"2024-08-31T12:21:52.509984+0000","last_active":"2024-08-31T12:21:52.509984+0000","last_peered":"2024-08-31T12:21:52.509984+0000","last_clean":"2024-08-31T12:21:52.509984+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:52.509984+0000","last_undegraded":"2024-08-31T12:21:52.509984+0000","last_fullsized":"2024-08-31T12:21:52.509984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'177","last_scrub_stamp":"2024-08-31T12:21:52.509906+0000","last_deep_scrub":"56'177","last_deep_scrub_stamp":"2024-08-31T12:21:52.509906+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.509906+0000","objects_scrubbed":6,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:59.120434+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":40983,"num_write":165,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'341","reported_seq":2500,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.818564+0000","last_change":"2024-08-31T12:22:05.818564+0000","last_active":"2024-08-31T12:22:05.818564+0000","last_peered":"2024-08-31T12:22:05.818564+0000","last_clean":"2024-08-31T12:22:05.818564+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:22:05.818564+0000","last_undegraded":"2024-08-31T12:22:05.818564+0000","last_fullsized":"2024-08-31T12:22:05.818564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'341","last_scrub_stamp":"2024-08-31T12:22:05.818359+0000","last_deep_scrub":"56'341","last_deep_scrub_stamp":"2024-08-31T12:22:05.818359+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.818359+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:48.316125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":338,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"56'86","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.918607+0000","last_change":"2024-08-31T12:22:04.918607+0000","last_active":"2024-08-31T12:22:04.918607+0000","last_peered":"2024-08-31T12:22:04.918607+0000","last_clean":"2024-08-31T12:22:04.918607+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:22:04.918607+0000","last_undegraded":"2024-08-31T12:22:04.918607+0000","last_fullsized":"2024-08-31T12:22:04.918607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'86","last_scrub_stamp":"2024-08-31T12:22:04.918452+0000","last_deep_scrub":"56'86","last_deep_scrub_stamp":"2024-08-31T12:22:04.918452+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.918452+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:52.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"56'252","reported_seq":356,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.960721+0000","last_change":"2024-08-31T12:21:53.960721+0000","last_active":"2024-08-31T12:21:53.960721+0000","last_peered":"2024-08-31T12:21:53.960721+0000","last_clean":"2024-08-31T12:21:53.960721+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:53.960721+0000","last_undegraded":"2024-08-31T12:21:53.960721+0000","last_fullsized":"2024-08-31T12:21:53.960721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'252","last_scrub_stamp":"2024-08-31T12:21:53.960459+0000","last_deep_scrub":"56'252","last_deep_scrub_stamp":"2024-08-31T12:21:53.960459+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.960459+0000","objects_scrubbed":3,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:37.818459+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":12307,"num_write":250,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'323","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.471328+0000","last_change":"2024-08-31T12:22:01.471328+0000","last_active":"2024-08-31T12:22:01.471328+0000","last_peered":"2024-08-31T12:22:01.471328+0000","last_clean":"2024-08-31T12:22:01.471328+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:22:01.471328+0000","last_undegraded":"2024-08-31T12:22:01.471328+0000","last_fullsized":"2024-08-31T12:22:01.471328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'323","last_scrub_stamp":"2024-08-31T12:22:01.471202+0000","last_deep_scrub":"56'323","last_deep_scrub_stamp":"2024-08-31T12:22:01.471202+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.471202+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:01:52.385947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":4139,"num_write":322,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.898031+0000","last_change":"2024-08-31T12:21:53.898031+0000","last_active":"2024-08-31T12:21:53.898031+0000","last_peered":"2024-08-31T12:21:53.898031+0000","last_clean":"2024-08-31T12:21:53.898031+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:53.898031+0000","last_undegraded":"2024-08-31T12:21:53.898031+0000","last_fullsized":"2024-08-31T12:21:53.898031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:53.897846+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:53.897846+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.897846+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:30:11.857169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'25","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.096554+0000","last_change":"2024-08-31T12:21:49.096554+0000","last_active":"2024-08-31T12:21:49.096554+0000","last_peered":"2024-08-31T12:21:49.096554+0000","last_clean":"2024-08-31T12:21:49.096554+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:49.096554+0000","last_undegraded":"2024-08-31T12:21:49.096554+0000","last_fullsized":"2024-08-31T12:21:49.096554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.096488+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:21.965086+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'358","reported_seq":2511,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.921208+0000","last_change":"2024-08-31T12:21:59.921208+0000","last_active":"2024-08-31T12:21:59.921208+0000","last_peered":"2024-08-31T12:21:59.921208+0000","last_clean":"2024-08-31T12:21:59.921208+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:59.921208+0000","last_undegraded":"2024-08-31T12:21:59.921208+0000","last_fullsized":"2024-08-31T12:21:59.921208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'358","last_scrub_stamp":"2024-08-31T12:21:59.920857+0000","last_deep_scrub":"56'358","last_deep_scrub_stamp":"2024-08-31T12:21:59.920857+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.920857+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:00.606074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":350,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"56'105","reported_seq":2227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.468027+0000","last_change":"2024-08-31T12:21:53.468027+0000","last_active":"2024-08-31T12:21:53.468027+0000","last_peered":"2024-08-31T12:21:53.468027+0000","last_clean":"2024-08-31T12:21:53.468027+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:53.468027+0000","last_undegraded":"2024-08-31T12:21:53.468027+0000","last_fullsized":"2024-08-31T12:21:53.468027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:53.467917+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:53.467917+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.467917+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:21.517989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"56'6","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.601108+0000","last_change":"2024-08-31T12:21:50.601108+0000","last_active":"2024-08-31T12:21:50.601108+0000","last_peered":"2024-08-31T12:21:50.601108+0000","last_clean":"2024-08-31T12:21:50.601108+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:50.601108+0000","last_undegraded":"2024-08-31T12:21:50.601108+0000","last_fullsized":"2024-08-31T12:21:50.601108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.601036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:36.462135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'338","reported_seq":2494,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.822528+0000","last_change":"2024-08-31T12:22:04.822528+0000","last_active":"2024-08-31T12:22:04.822528+0000","last_peered":"2024-08-31T12:22:04.822528+0000","last_clean":"2024-08-31T12:22:04.822528+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:22:04.822528+0000","last_undegraded":"2024-08-31T12:22:04.822528+0000","last_fullsized":"2024-08-31T12:22:04.822528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'338","last_scrub_stamp":"2024-08-31T12:22:04.822209+0000","last_deep_scrub":"56'338","last_deep_scrub_stamp":"2024-08-31T12:22:04.822209+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.822209+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:17.533730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":338,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2467,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.830376+0000","last_change":"2024-08-31T12:22:07.830376+0000","last_active":"2024-08-31T12:22:07.830376+0000","last_peered":"2024-08-31T12:22:07.830376+0000","last_clean":"2024-08-31T12:22:07.830376+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:22:07.830376+0000","last_undegraded":"2024-08-31T12:22:07.830376+0000","last_fullsized":"2024-08-31T12:22:07.830376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'320","last_scrub_stamp":"2024-08-31T12:22:07.830058+0000","last_deep_scrub":"56'320","last_deep_scrub_stamp":"2024-08-31T12:22:07.830058+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.830058+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:05.276989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.791345+0000","last_change":"2024-08-31T12:21:59.791345+0000","last_active":"2024-08-31T12:21:59.791345+0000","last_peered":"2024-08-31T12:21:59.791345+0000","last_clean":"2024-08-31T12:21:59.791345+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:59.791345+0000","last_undegraded":"2024-08-31T12:21:59.791345+0000","last_fullsized":"2024-08-31T12:21:59.791345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:59.791153+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:59.791153+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.791153+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:44.697365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"56'223","reported_seq":321,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.924537+0000","last_change":"2024-08-31T12:22:00.924537+0000","last_active":"2024-08-31T12:22:00.924537+0000","last_peered":"2024-08-31T12:22:00.924537+0000","last_clean":"2024-08-31T12:22:00.924537+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:22:00.924537+0000","last_undegraded":"2024-08-31T12:22:00.924537+0000","last_fullsized":"2024-08-31T12:22:00.924537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'223","last_scrub_stamp":"2024-08-31T12:22:00.924455+0000","last_deep_scrub":"56'223","last_deep_scrub_stamp":"2024-08-31T12:22:00.924455+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.924455+0000","objects_scrubbed":2,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:17.844779+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'327","reported_seq":2474,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:42.979219+0000","last_change":"2024-08-31T12:19:51.192804+0000","last_active":"2024-08-31T12:21:42.979219+0000","last_peered":"2024-08-31T12:21:42.979219+0000","last_clean":"2024-08-31T12:21:42.979219+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:21:42.979219+0000","last_undegraded":"2024-08-31T12:21:42.979219+0000","last_fullsized":"2024-08-31T12:21:42.979219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:49.682698+0000","last_clean_scrub_stamp":"2024-08-31T12:13:49.682698+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":326,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"56'109","reported_seq":2231,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.907300+0000","last_change":"2024-08-31T12:21:56.907300+0000","last_active":"2024-08-31T12:21:56.907300+0000","last_peered":"2024-08-31T12:21:56.907300+0000","last_clean":"2024-08-31T12:21:56.907300+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:56.907300+0000","last_undegraded":"2024-08-31T12:21:56.907300+0000","last_fullsized":"2024-08-31T12:21:56.907300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:56.906981+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:56.906981+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.906981+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:07:05.610056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"56'25","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.577447+0000","last_change":"2024-08-31T12:21:54.577447+0000","last_active":"2024-08-31T12:21:54.577447+0000","last_peered":"2024-08-31T12:21:54.577447+0000","last_clean":"2024-08-31T12:21:54.577447+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:54.577447+0000","last_undegraded":"2024-08-31T12:21:54.577447+0000","last_fullsized":"2024-08-31T12:21:54.577447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-08-31T12:21:54.576891+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-08-31T12:21:54.576891+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.576891+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:04.497495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"56'105","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.963841+0000","last_change":"2024-08-31T12:21:57.963841+0000","last_active":"2024-08-31T12:21:57.963841+0000","last_peered":"2024-08-31T12:21:57.963841+0000","last_clean":"2024-08-31T12:21:57.963841+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:57.963841+0000","last_undegraded":"2024-08-31T12:21:57.963841+0000","last_fullsized":"2024-08-31T12:21:57.963841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:57.963752+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:57.963752+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.963752+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:56:25.214409+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.816713+0000","last_change":"2024-08-31T12:22:01.816713+0000","last_active":"2024-08-31T12:22:01.816713+0000","last_peered":"2024-08-31T12:22:01.816713+0000","last_clean":"2024-08-31T12:22:01.816713+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:22:01.816713+0000","last_undegraded":"2024-08-31T12:22:01.816713+0000","last_fullsized":"2024-08-31T12:22:01.816713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:01.816518+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:01.816518+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.816518+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:20.204165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'305","reported_seq":2447,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.851209+0000","last_change":"2024-08-31T12:22:06.851209+0000","last_active":"2024-08-31T12:22:06.851209+0000","last_peered":"2024-08-31T12:22:06.851209+0000","last_clean":"2024-08-31T12:22:06.851209+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:22:06.851209+0000","last_undegraded":"2024-08-31T12:22:06.851209+0000","last_fullsized":"2024-08-31T12:22:06.851209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'305","last_scrub_stamp":"2024-08-31T12:22:06.850991+0000","last_deep_scrub":"56'305","last_deep_scrub_stamp":"2024-08-31T12:22:06.850991+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.850991+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:14:14.155816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":304,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'60","reported_seq":157,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.944464+0000","last_change":"2024-08-31T12:21:58.944464+0000","last_active":"2024-08-31T12:21:58.944464+0000","last_peered":"2024-08-31T12:21:58.944464+0000","last_clean":"2024-08-31T12:21:58.944464+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:58.944464+0000","last_undegraded":"2024-08-31T12:21:58.944464+0000","last_fullsized":"2024-08-31T12:21:58.944464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-08-31T12:21:58.944263+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-08-31T12:21:58.944263+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.944263+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:37.968801+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6858,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"56'85","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.553850+0000","last_change":"2024-08-31T12:21:51.553850+0000","last_active":"2024-08-31T12:21:51.553850+0000","last_peered":"2024-08-31T12:21:51.553850+0000","last_clean":"2024-08-31T12:21:51.553850+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:51.553850+0000","last_undegraded":"2024-08-31T12:21:51.553850+0000","last_fullsized":"2024-08-31T12:21:51.553850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:21:51.553754+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:21:51.553754+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.553754+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:53.962596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'322","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.900477+0000","last_change":"2024-08-31T12:22:01.900477+0000","last_active":"2024-08-31T12:22:01.900477+0000","last_peered":"2024-08-31T12:22:01.900477+0000","last_clean":"2024-08-31T12:22:01.900477+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:22:01.900477+0000","last_undegraded":"2024-08-31T12:22:01.900477+0000","last_fullsized":"2024-08-31T12:22:01.900477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'322","last_scrub_stamp":"2024-08-31T12:22:01.900269+0000","last_deep_scrub":"56'322","last_deep_scrub_stamp":"2024-08-31T12:22:01.900269+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.900269+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:37:12.865745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":8234,"num_write":320,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"56'109","reported_seq":2232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.465348+0000","last_change":"2024-08-31T12:21:54.465276+0000","last_active":"2024-08-31T12:21:54.465348+0000","last_peered":"2024-08-31T12:21:54.465348+0000","last_clean":"2024-08-31T12:21:54.465348+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:54.465348+0000","last_undegraded":"2024-08-31T12:21:54.465348+0000","last_fullsized":"2024-08-31T12:21:54.465348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:54.465190+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:54.465190+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.465190+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:53.857159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"56'111","reported_seq":2233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.918399+0000","last_change":"2024-08-31T12:21:58.918117+0000","last_active":"2024-08-31T12:21:58.918399+0000","last_peered":"2024-08-31T12:21:58.918399+0000","last_clean":"2024-08-31T12:21:58.918399+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:58.918399+0000","last_undegraded":"2024-08-31T12:21:58.918399+0000","last_fullsized":"2024-08-31T12:21:58.918399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-08-31T12:21:58.917883+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-08-31T12:21:58.917883+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.917883+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:23.511452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"56'101","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.893639+0000","last_change":"2024-08-31T12:22:06.893639+0000","last_active":"2024-08-31T12:22:06.893639+0000","last_peered":"2024-08-31T12:22:06.893639+0000","last_clean":"2024-08-31T12:22:06.893639+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:22:06.893639+0000","last_undegraded":"2024-08-31T12:22:06.893639+0000","last_fullsized":"2024-08-31T12:22:06.893639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'101","last_scrub_stamp":"2024-08-31T12:22:06.893546+0000","last_deep_scrub":"56'101","last_deep_scrub_stamp":"2024-08-31T12:22:06.893546+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.893546+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:00.419090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"56'99","reported_seq":2222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.891070+0000","last_change":"2024-08-31T12:21:57.890773+0000","last_active":"2024-08-31T12:21:57.891070+0000","last_peered":"2024-08-31T12:21:57.891070+0000","last_clean":"2024-08-31T12:21:57.891070+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:57.891070+0000","last_undegraded":"2024-08-31T12:21:57.891070+0000","last_fullsized":"2024-08-31T12:21:57.891070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'99","last_scrub_stamp":"2024-08-31T12:21:57.890466+0000","last_deep_scrub":"56'99","last_deep_scrub_stamp":"2024-08-31T12:21:57.890466+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.890466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:19.780314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"56'80","reported_seq":2202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.558608+0000","last_change":"2024-08-31T12:21:58.558608+0000","last_active":"2024-08-31T12:21:58.558608+0000","last_peered":"2024-08-31T12:21:58.558608+0000","last_clean":"2024-08-31T12:21:58.558608+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:58.558608+0000","last_undegraded":"2024-08-31T12:21:58.558608+0000","last_fullsized":"2024-08-31T12:21:58.558608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'80","last_scrub_stamp":"2024-08-31T12:21:58.558410+0000","last_deep_scrub":"56'80","last_deep_scrub_stamp":"2024-08-31T12:21:58.558410+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.558410+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:17.846661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"56'73","reported_seq":2195,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.547927+0000","last_change":"2024-08-31T12:21:59.547927+0000","last_active":"2024-08-31T12:21:59.547927+0000","last_peered":"2024-08-31T12:21:59.547927+0000","last_clean":"2024-08-31T12:21:59.547927+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:59.547927+0000","last_undegraded":"2024-08-31T12:21:59.547927+0000","last_fullsized":"2024-08-31T12:21:59.547927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'73","last_scrub_stamp":"2024-08-31T12:21:59.547734+0000","last_deep_scrub":"56'73","last_deep_scrub_stamp":"2024-08-31T12:21:59.547734+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.547734+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:20:08.837141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"56'109","reported_seq":2231,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.496976+0000","last_change":"2024-08-31T12:21:55.496976+0000","last_active":"2024-08-31T12:21:55.496976+0000","last_peered":"2024-08-31T12:21:55.496976+0000","last_clean":"2024-08-31T12:21:55.496976+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:55.496976+0000","last_undegraded":"2024-08-31T12:21:55.496976+0000","last_fullsized":"2024-08-31T12:21:55.496976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:55.496895+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:55.496895+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.496895+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:45.970404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"56'83","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.900868+0000","last_change":"2024-08-31T12:22:03.900868+0000","last_active":"2024-08-31T12:22:03.900868+0000","last_peered":"2024-08-31T12:22:03.900868+0000","last_clean":"2024-08-31T12:22:03.900868+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:22:03.900868+0000","last_undegraded":"2024-08-31T12:22:03.900868+0000","last_fullsized":"2024-08-31T12:22:03.900868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:03.900619+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:03.900619+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.900619+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:49.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"56'93","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.869385+0000","last_change":"2024-08-31T12:22:05.869385+0000","last_active":"2024-08-31T12:22:05.869385+0000","last_peered":"2024-08-31T12:22:05.869385+0000","last_clean":"2024-08-31T12:22:05.869385+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:22:05.869385+0000","last_undegraded":"2024-08-31T12:22:05.869385+0000","last_fullsized":"2024-08-31T12:22:05.869385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:05.869298+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:05.869298+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.869298+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:28.179568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"56'93","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.906601+0000","last_change":"2024-08-31T12:22:04.906601+0000","last_active":"2024-08-31T12:22:04.906601+0000","last_peered":"2024-08-31T12:22:04.906601+0000","last_clean":"2024-08-31T12:22:04.906601+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:22:04.906601+0000","last_undegraded":"2024-08-31T12:22:04.906601+0000","last_fullsized":"2024-08-31T12:22:04.906601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:04.906404+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:04.906404+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.906404+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:52.904294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"56'96","reported_seq":2217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.610570+0000","last_change":"2024-08-31T12:21:53.610570+0000","last_active":"2024-08-31T12:21:53.610570+0000","last_peered":"2024-08-31T12:21:53.610570+0000","last_clean":"2024-08-31T12:21:53.610570+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:53.610570+0000","last_undegraded":"2024-08-31T12:21:53.610570+0000","last_fullsized":"2024-08-31T12:21:53.610570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'96","last_scrub_stamp":"2024-08-31T12:21:53.610492+0000","last_deep_scrub":"56'96","last_deep_scrub_stamp":"2024-08-31T12:21:53.610492+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.610492+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:11.784185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.834246+0000","last_change":"2024-08-31T12:22:02.834246+0000","last_active":"2024-08-31T12:22:02.834246+0000","last_peered":"2024-08-31T12:22:02.834246+0000","last_clean":"2024-08-31T12:22:02.834246+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:22:02.834246+0000","last_undegraded":"2024-08-31T12:22:02.834246+0000","last_fullsized":"2024-08-31T12:22:02.834246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:02.834046+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:02.834046+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.834046+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:06.250348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"56'97","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.076314+0000","last_change":"2024-08-31T12:22:01.076314+0000","last_active":"2024-08-31T12:22:01.076314+0000","last_peered":"2024-08-31T12:22:01.076314+0000","last_clean":"2024-08-31T12:22:01.076314+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:22:01.076314+0000","last_undegraded":"2024-08-31T12:22:01.076314+0000","last_fullsized":"2024-08-31T12:22:01.076314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:22:01.076211+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:22:01.076211+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.076211+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:17.054637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"56'85","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:08.940277+0000","last_change":"2024-08-31T12:22:08.940277+0000","last_active":"2024-08-31T12:22:08.940277+0000","last_peered":"2024-08-31T12:22:08.940277+0000","last_clean":"2024-08-31T12:22:08.940277+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:22:08.940277+0000","last_undegraded":"2024-08-31T12:22:08.940277+0000","last_fullsized":"2024-08-31T12:22:08.940277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:22:08.940190+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:22:08.940190+0000","last_clean_scrub_stamp":"2024-08-31T12:22:08.940190+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:26.282149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"56'89","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.906409+0000","last_change":"2024-08-31T12:21:55.906409+0000","last_active":"2024-08-31T12:21:55.906409+0000","last_peered":"2024-08-31T12:21:55.906409+0000","last_clean":"2024-08-31T12:21:55.906409+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:55.906409+0000","last_undegraded":"2024-08-31T12:21:55.906409+0000","last_fullsized":"2024-08-31T12:21:55.906409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:55.906225+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:55.906225+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.906225+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:33:43.196096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"56'95","reported_seq":2216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:10.980024+0000","last_change":"2024-08-31T12:22:10.980024+0000","last_active":"2024-08-31T12:22:10.980024+0000","last_peered":"2024-08-31T12:22:10.980024+0000","last_clean":"2024-08-31T12:22:10.980024+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:22:10.980024+0000","last_undegraded":"2024-08-31T12:22:10.980024+0000","last_fullsized":"2024-08-31T12:22:10.980024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'95","last_scrub_stamp":"2024-08-31T12:22:10.979932+0000","last_deep_scrub":"56'95","last_deep_scrub_stamp":"2024-08-31T12:22:10.979932+0000","last_clean_scrub_stamp":"2024-08-31T12:22:10.979932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:47.498920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"56'97","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:44.684754+0000","last_change":"2024-08-31T12:19:51.185985+0000","last_active":"2024-08-31T12:21:44.684754+0000","last_peered":"2024-08-31T12:21:44.684754+0000","last_clean":"2024-08-31T12:21:44.684754+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:21:44.684754+0000","last_undegraded":"2024-08-31T12:21:44.684754+0000","last_fullsized":"2024-08-31T12:21:44.684754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:13:45.635237+0000","last_clean_scrub_stamp":"2024-08-31T12:13:45.635237+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:21.405555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"56'85","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.867243+0000","last_change":"2024-08-31T12:22:05.867243+0000","last_active":"2024-08-31T12:22:05.867243+0000","last_peered":"2024-08-31T12:22:05.867243+0000","last_clean":"2024-08-31T12:22:05.867243+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:22:05.867243+0000","last_undegraded":"2024-08-31T12:22:05.867243+0000","last_fullsized":"2024-08-31T12:22:05.867243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:22:05.866905+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:22:05.866905+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.866905+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:14.522083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.609309+0000","last_change":"2024-08-31T12:22:01.609309+0000","last_active":"2024-08-31T12:22:01.609309+0000","last_peered":"2024-08-31T12:22:01.609309+0000","last_clean":"2024-08-31T12:22:01.609309+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:22:01.609309+0000","last_undegraded":"2024-08-31T12:22:01.609309+0000","last_fullsized":"2024-08-31T12:22:01.609309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:22:01.609033+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:22:01.609033+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.609033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:59.546816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"56'81","reported_seq":2203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.559249+0000","last_change":"2024-08-31T12:22:00.559249+0000","last_active":"2024-08-31T12:22:00.559249+0000","last_peered":"2024-08-31T12:22:00.559249+0000","last_clean":"2024-08-31T12:22:00.559249+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:22:00.559249+0000","last_undegraded":"2024-08-31T12:22:00.559249+0000","last_fullsized":"2024-08-31T12:22:00.559249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-08-31T12:22:00.559056+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-08-31T12:22:00.559056+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.559056+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:17:07.875378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"56'76","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.061185+0000","last_change":"2024-08-31T12:22:03.061185+0000","last_active":"2024-08-31T12:22:03.061185+0000","last_peered":"2024-08-31T12:22:03.061185+0000","last_clean":"2024-08-31T12:22:03.061185+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:22:03.061185+0000","last_undegraded":"2024-08-31T12:22:03.061185+0000","last_fullsized":"2024-08-31T12:22:03.061185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76","last_scrub_stamp":"2024-08-31T12:22:03.061096+0000","last_deep_scrub":"56'76","last_deep_scrub_stamp":"2024-08-31T12:22:03.061096+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.061096+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:18:27.184378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"56'92","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.982597+0000","last_change":"2024-08-31T12:22:05.982597+0000","last_active":"2024-08-31T12:22:05.982597+0000","last_peered":"2024-08-31T12:22:05.982597+0000","last_clean":"2024-08-31T12:22:05.982597+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:22:05.982597+0000","last_undegraded":"2024-08-31T12:22:05.982597+0000","last_fullsized":"2024-08-31T12:22:05.982597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:22:05.982501+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:22:05.982501+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.982501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:27:45.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"56'98","reported_seq":2219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.042399+0000","last_change":"2024-08-31T12:21:54.042399+0000","last_active":"2024-08-31T12:21:54.042399+0000","last_peered":"2024-08-31T12:21:54.042399+0000","last_clean":"2024-08-31T12:21:54.042399+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:54.042399+0000","last_undegraded":"2024-08-31T12:21:54.042399+0000","last_fullsized":"2024-08-31T12:21:54.042399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-08-31T12:21:54.042306+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-08-31T12:21:54.042306+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.042306+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:51.984061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"56'84","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.565583+0000","last_change":"2024-08-31T12:21:55.565583+0000","last_active":"2024-08-31T12:21:55.565583+0000","last_peered":"2024-08-31T12:21:55.565583+0000","last_clean":"2024-08-31T12:21:55.565583+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:55.565583+0000","last_undegraded":"2024-08-31T12:21:55.565583+0000","last_fullsized":"2024-08-31T12:21:55.565583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'84","last_scrub_stamp":"2024-08-31T12:21:55.565502+0000","last_deep_scrub":"56'84","last_deep_scrub_stamp":"2024-08-31T12:21:55.565502+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.565502+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:43:40.464671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"56'74","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.934164+0000","last_change":"2024-08-31T12:21:59.934164+0000","last_active":"2024-08-31T12:21:59.934164+0000","last_peered":"2024-08-31T12:21:59.934164+0000","last_clean":"2024-08-31T12:21:59.934164+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:59.934164+0000","last_undegraded":"2024-08-31T12:21:59.934164+0000","last_fullsized":"2024-08-31T12:21:59.934164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74","last_scrub_stamp":"2024-08-31T12:21:59.933979+0000","last_deep_scrub":"56'74","last_deep_scrub_stamp":"2024-08-31T12:21:59.933979+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.933979+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:36:24.972114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"56'105","reported_seq":2226,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.082373+0000","last_change":"2024-08-31T12:21:56.082373+0000","last_active":"2024-08-31T12:21:56.082373+0000","last_peered":"2024-08-31T12:21:56.082373+0000","last_clean":"2024-08-31T12:21:56.082373+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:56.082373+0000","last_undegraded":"2024-08-31T12:21:56.082373+0000","last_fullsized":"2024-08-31T12:21:56.082373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:56.082275+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:56.082275+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.082275+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:28.430629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.478084+0000","last_change":"2024-08-31T12:21:56.478084+0000","last_active":"2024-08-31T12:21:56.478084+0000","last_peered":"2024-08-31T12:21:56.478084+0000","last_clean":"2024-08-31T12:21:56.478084+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:56.478084+0000","last_undegraded":"2024-08-31T12:21:56.478084+0000","last_fullsized":"2024-08-31T12:21:56.478084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:56.477979+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:56.477979+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.477979+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:47:51.276480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"56'102","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.080471+0000","last_change":"2024-08-31T12:21:58.080471+0000","last_active":"2024-08-31T12:21:58.080471+0000","last_peered":"2024-08-31T12:21:58.080471+0000","last_clean":"2024-08-31T12:21:58.080471+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:58.080471+0000","last_undegraded":"2024-08-31T12:21:58.080471+0000","last_fullsized":"2024-08-31T12:21:58.080471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-08-31T12:21:58.080375+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-08-31T12:21:58.080375+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.080375+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:01:50.008145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"56'76","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.475583+0000","last_change":"2024-08-31T12:21:57.475583+0000","last_active":"2024-08-31T12:21:57.475583+0000","last_peered":"2024-08-31T12:21:57.475583+0000","last_clean":"2024-08-31T12:21:57.475583+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:57.475583+0000","last_undegraded":"2024-08-31T12:21:57.475583+0000","last_fullsized":"2024-08-31T12:21:57.475583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76","last_scrub_stamp":"2024-08-31T12:21:57.475493+0000","last_deep_scrub":"56'76","last_deep_scrub_stamp":"2024-08-31T12:21:57.475493+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.475493+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:19:52.256957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"56'90","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.900401+0000","last_change":"2024-08-31T12:22:02.900180+0000","last_active":"2024-08-31T12:22:02.900401+0000","last_peered":"2024-08-31T12:22:02.900401+0000","last_clean":"2024-08-31T12:22:02.900401+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:22:02.900401+0000","last_undegraded":"2024-08-31T12:22:02.900401+0000","last_fullsized":"2024-08-31T12:22:02.900401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:02.899951+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:02.899951+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.899951+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:34.271798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"56'75","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.829744+0000","last_change":"2024-08-31T12:22:06.829744+0000","last_active":"2024-08-31T12:22:06.829744+0000","last_peered":"2024-08-31T12:22:06.829744+0000","last_clean":"2024-08-31T12:22:06.829744+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:22:06.829744+0000","last_undegraded":"2024-08-31T12:22:06.829744+0000","last_fullsized":"2024-08-31T12:22:06.829744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'75","last_scrub_stamp":"2024-08-31T12:22:06.829419+0000","last_deep_scrub":"56'75","last_deep_scrub_stamp":"2024-08-31T12:22:06.829419+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.829419+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:17.669839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"56'86","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.059008+0000","last_change":"2024-08-31T12:22:00.058930+0000","last_active":"2024-08-31T12:22:00.059008+0000","last_peered":"2024-08-31T12:22:00.059008+0000","last_clean":"2024-08-31T12:22:00.059008+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:22:00.059008+0000","last_undegraded":"2024-08-31T12:22:00.059008+0000","last_fullsized":"2024-08-31T12:22:00.059008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'86","last_scrub_stamp":"2024-08-31T12:22:00.058851+0000","last_deep_scrub":"56'86","last_deep_scrub_stamp":"2024-08-31T12:22:00.058851+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.058851+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:49.251754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1223,"num_read_kb":65823,"num_write":10786,"num_write_kb":548212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10841,"ondisk_log_size":10841,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5791,"ondisk_log_size":5791,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144722655,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":487,"num_read_kb":466052,"num_write":4557,"num_write_kb":144703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11858,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":289505280,"data_stored":289445310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4455,"ondisk_log_size":4455,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509546,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137480,"kb_used_data":25784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94234360,"statfs":{"total":96636764160,"available":96495984640,"internally_reserved":0,"allocated":26402816,"data_stored":26087849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106440,"kb_used_data":21112,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94265400,"statfs":{"total":96636764160,"available":96527769600,"internally_reserved":0,"allocated":21618688,"data_stored":21314193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509547,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119884,"kb_used_data":34556,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251956,"statfs":{"total":96636764160,"available":96514002944,"internally_reserved":0,"allocated":35385344,"data_stored":35066793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139212,"kb_used_data":53884,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232628,"statfs":{"total":96636764160,"available":96494211072,"internally_reserved":0,"allocated":55177216,"data_stored":54869207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509547,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96656,"kb_used_data":25216,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94275184,"statfs":{"total":96636764160,"available":96537788416,"internally_reserved":0,"allocated":25821184,"data_stored":25509169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509547,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115152,"kb_used_data":33984,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94256688,"statfs":{"total":96636764160,"available":96518848512,"internally_reserved":0,"allocated":34799616,"data_stored":34487543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167084,"kb_used_data":55388,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94204756,"statfs":{"total":96636764160,"available":96465670144,"internally_reserved":0,"allocated":56717312,"data_stored":56404302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128500,"kb_used_data":39012,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243340,"statfs":{"total":96636764160,"available":96505180160,"internally_reserved":0,"allocated":39948288,"data_stored":39628374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56070144,"data_stored":56061629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39301120,"data_stored":39285701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34144256,"data_stored":34133752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25755648,"data_stored":25745176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:22:13.273 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:22:13.273 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:22:13.274 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:22:13.274 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-31T12:13:49.682698+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=49, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:22:13.275 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-31T12:13:45.635237+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=12, tm_min=21, tm_sec=46, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T12:22:13.275 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-31T12:22:33.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:22:33.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- 172.21.15.164:0/446304944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c1f40 msgr2=0x7fdb040c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 --2- 172.21.15.164:0/446304944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c1f40 0x7fdb040c9330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdb040c9020 tx=0x7fdaf001f0d0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- 172.21.15.164:0/446304944 shutdown_connections 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 --2- 172.21.15.164:0/446304944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c1f40 0x7fdb040c9330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 --2- 172.21.15.164:0/446304944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 0x7fdb04152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- 172.21.15.164:0/446304944 >> 172.21.15.164:0/446304944 conn(0x7fdb040ccf20 msgr2=0x7fdb040cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- 172.21.15.164:0/446304944 shutdown_connections 2024-08-31T12:22:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- 172.21.15.164:0/446304944 wait complete. 2024-08-31T12:22:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 Processor -- start 2024-08-31T12:22:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.442+0000 7fdb08e00640 1 -- start start 2024-08-31T12:22:33.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb040c1f40 0x7fdb041f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 0x7fdb0414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04074fb0 con 0x7fdb040c7920 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04074e30 con 0x7fdb040c1f40 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdb040c7d30 con 0x7fdb0415bc70 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38958/0 (socket says 172.21.15.164:38958) 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 -- 172.21.15.164:0/971313387 learned_addr learned my addr 172.21.15.164:0/971313387 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb040c1f40 0x7fdb041f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb02800640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 0x7fdb0414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 -- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 msgr2=0x7fdb0414fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 0x7fdb0414fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 -- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb040c1f40 msgr2=0x7fdb041f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb040c1f40 0x7fdb041f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 -- 172.21.15.164:0/971313387 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb041f26f0 con 0x7fdb040c7920 2024-08-31T12:22:33.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb01400640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00b3040 tx=0x7fdaf0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:33.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00b5040 con 0x7fdb040c7920 2024-08-31T12:22:33.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaf0005320 con 0x7fdb040c7920 2024-08-31T12:22:33.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00046d0 con 0x7fdb040c7920 2024-08-31T12:22:33.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb041e2390 con 0x7fdb040c7920 2024-08-31T12:22:33.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb040b0840 con 0x7fdb040c7920 2024-08-31T12:22:33.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb040c9330 con 0x7fdb040c7920 2024-08-31T12:22:33.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.446+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdaf0004870 con 0x7fdb040c7920 2024-08-31T12:22:33.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.450+0000 7fdafa000640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 0x7fdae40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.450+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fdaf012ffe0 con 0x7fdb040c7920 2024-08-31T12:22:33.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.450+0000 7fdb01e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 0x7fdae40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.450+0000 7fdb01e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 0x7fdae40745d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40058d0 tx=0x7fdaf4005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:33.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.454+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdaf0018c30 con 0x7fdb040c7920 2024-08-31T12:22:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.618+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 --> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb04074020 con 0x7fdae40720c0 2024-08-31T12:22:33.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.634+0000 7fdafa000640 1 -- 172.21.15.164:0/971313387 <== mgr.4132 v2:172.21.15.184:6808/1260951868 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336363 (secure 0 0 0) 0x7fdb04074020 con 0x7fdae40720c0 2024-08-31T12:22:33.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:22:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-08-31T12:22:33.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 msgr2=0x7fdae40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 0x7fdae40745d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40058d0 tx=0x7fdaf4005860 comp rx=0 tx=0).stop 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 msgr2=0x7fdb040afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00b3040 tx=0x7fdaf0004600 comp rx=0 tx=0).stop 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 shutdown_connections 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdae40720c0 0x7fdae40745d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb0415bc70 0x7fdb0414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb040c7920 0x7fdb040afda0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 --2- 172.21.15.164:0/971313387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb040c1f40 0x7fdb041f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 >> 172.21.15.164:0/971313387 conn(0x7fdb040ccf20 msgr2=0x7fdb04070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 shutdown_connections 2024-08-31T12:22:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.638+0000 7fdb08e00640 1 -- 172.21.15.164:0/971313387 wait complete. 2024-08-31T12:22:33.660 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-08-31T12:22:32.778851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":145313023,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1776,"num_read_kb":531930,"num_write":15444,"num_write_kb":694543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11858,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21161,"ondisk_log_size":21161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1010408,"kb_used_data":288936,"kb_used_omap":12,"kb_used_meta":721331,"kb_avail":753964312,"statfs":{"total":773094113280,"available":772059455488,"internally_reserved":0,"allocated":295870464,"data_stored":293367430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":738643505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005889"},"pg_stats":[{"pgid":"2.1f","version":"56'62","reported_seq":168,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.717612+0000","last_change":"2024-08-31T12:21:54.717411+0000","last_active":"2024-08-31T12:21:54.717612+0000","last_peered":"2024-08-31T12:21:54.717612+0000","last_clean":"2024-08-31T12:21:54.717612+0000","last_became_active":"2024-08-31T12:13:45.679200+0000","last_became_peered":"2024-08-31T12:13:45.679200+0000","last_unstale":"2024-08-31T12:21:54.717612+0000","last_undegraded":"2024-08-31T12:21:54.717612+0000","last_fullsized":"2024-08-31T12:21:54.717612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'62","last_scrub_stamp":"2024-08-31T12:21:54.717135+0000","last_deep_scrub":"56'62","last_deep_scrub_stamp":"2024-08-31T12:21:54.717135+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.717135+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:13:02.117484+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":16400,"num_write":55,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"56'92","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.886912+0000","last_change":"2024-08-31T12:21:55.886912+0000","last_active":"2024-08-31T12:21:55.886912+0000","last_peered":"2024-08-31T12:21:55.886912+0000","last_clean":"2024-08-31T12:21:55.886912+0000","last_became_active":"2024-08-31T12:13:46.703232+0000","last_became_peered":"2024-08-31T12:13:46.703232+0000","last_unstale":"2024-08-31T12:21:55.886912+0000","last_undegraded":"2024-08-31T12:21:55.886912+0000","last_fullsized":"2024-08-31T12:21:55.886912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:55.886709+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:55.886709+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.886709+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:14:36.282674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.229108005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"56'369","reported_seq":2526,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.938131+0000","last_change":"2024-08-31T12:22:00.938131+0000","last_active":"2024-08-31T12:22:00.938131+0000","last_peered":"2024-08-31T12:22:00.938131+0000","last_clean":"2024-08-31T12:22:00.938131+0000","last_became_active":"2024-08-31T12:13:50.753879+0000","last_became_peered":"2024-08-31T12:13:50.753879+0000","last_unstale":"2024-08-31T12:22:00.938131+0000","last_undegraded":"2024-08-31T12:22:00.938131+0000","last_fullsized":"2024-08-31T12:22:00.938131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'369","last_scrub_stamp":"2024-08-31T12:22:00.937794+0000","last_deep_scrub":"56'369","last_deep_scrub_stamp":"2024-08-31T12:22:00.937794+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.937794+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:12:22.252144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14887682999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":4130,"num_write":366,"num_write_kb":28848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"56'83","reported_seq":182,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.956541+0000","last_change":"2024-08-31T12:22:01.956541+0000","last_active":"2024-08-31T12:22:01.956541+0000","last_peered":"2024-08-31T12:22:01.956541+0000","last_clean":"2024-08-31T12:22:01.956541+0000","last_became_active":"2024-08-31T12:13:45.688878+0000","last_became_peered":"2024-08-31T12:13:45.688878+0000","last_unstale":"2024-08-31T12:22:01.956541+0000","last_undegraded":"2024-08-31T12:22:01.956541+0000","last_fullsized":"2024-08-31T12:22:01.956541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:01.956287+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:01.956287+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.956287+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:53:31.953743+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":79,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"56'87","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.958086+0000","last_change":"2024-08-31T12:22:00.957809+0000","last_active":"2024-08-31T12:22:00.958086+0000","last_peered":"2024-08-31T12:22:00.958086+0000","last_clean":"2024-08-31T12:22:00.958086+0000","last_became_active":"2024-08-31T12:13:46.704924+0000","last_became_peered":"2024-08-31T12:13:46.704924+0000","last_unstale":"2024-08-31T12:22:00.958086+0000","last_undegraded":"2024-08-31T12:22:00.958086+0000","last_fullsized":"2024-08-31T12:22:00.958086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:22:00.957506+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:22:00.957506+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.957506+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:34:25.382495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.225868175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"56'352","reported_seq":2510,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.512509+0000","last_change":"2024-08-31T12:22:02.512509+0000","last_active":"2024-08-31T12:22:02.512509+0000","last_peered":"2024-08-31T12:22:02.512509+0000","last_clean":"2024-08-31T12:22:02.512509+0000","last_became_active":"2024-08-31T12:13:50.752677+0000","last_became_peered":"2024-08-31T12:13:50.752677+0000","last_unstale":"2024-08-31T12:22:02.512509+0000","last_undegraded":"2024-08-31T12:22:02.512509+0000","last_fullsized":"2024-08-31T12:22:02.512509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'352","last_scrub_stamp":"2024-08-31T12:22:02.512416+0000","last_deep_scrub":"56'352","last_deep_scrub_stamp":"2024-08-31T12:22:02.512416+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.512416+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:49:21.167999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.197857434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":4129,"num_write":351,"num_write_kb":41129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"56'1943","reported_seq":2050,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.141295+0000","last_change":"2024-08-31T12:22:02.141295+0000","last_active":"2024-08-31T12:22:02.141295+0000","last_peered":"2024-08-31T12:22:02.141295+0000","last_clean":"2024-08-31T12:22:02.141295+0000","last_became_active":"2024-08-31T12:13:45.672901+0000","last_became_peered":"2024-08-31T12:13:45.672901+0000","last_unstale":"2024-08-31T12:22:02.141295+0000","last_undegraded":"2024-08-31T12:22:02.141295+0000","last_fullsized":"2024-08-31T12:22:02.141295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1943","last_scrub_stamp":"2024-08-31T12:22:02.141206+0000","last_deep_scrub":"56'1943","last_deep_scrub_stamp":"2024-08-31T12:22:02.141206+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.141206+0000","objects_scrubbed":4,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:50.708205+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":38903,"num_write":1928,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"56'92","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.598498+0000","last_change":"2024-08-31T12:21:56.598498+0000","last_active":"2024-08-31T12:21:56.598498+0000","last_peered":"2024-08-31T12:21:56.598498+0000","last_clean":"2024-08-31T12:21:56.598498+0000","last_became_active":"2024-08-31T12:13:46.660427+0000","last_became_peered":"2024-08-31T12:13:46.660427+0000","last_unstale":"2024-08-31T12:21:56.598498+0000","last_undegraded":"2024-08-31T12:21:56.598498+0000","last_fullsized":"2024-08-31T12:21:56.598498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:56.598399+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:56.598399+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.598399+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:22.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118820092,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"56'369","reported_seq":2525,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.442451+0000","last_change":"2024-08-31T12:22:04.442451+0000","last_active":"2024-08-31T12:22:04.442451+0000","last_peered":"2024-08-31T12:22:04.442451+0000","last_clean":"2024-08-31T12:22:04.442451+0000","last_became_active":"2024-08-31T12:13:50.732315+0000","last_became_peered":"2024-08-31T12:13:50.732315+0000","last_unstale":"2024-08-31T12:22:04.442451+0000","last_undegraded":"2024-08-31T12:22:04.442451+0000","last_fullsized":"2024-08-31T12:22:04.442451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'369","last_scrub_stamp":"2024-08-31T12:22:04.442361+0000","last_deep_scrub":"56'369","last_deep_scrub_stamp":"2024-08-31T12:22:04.442361+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.442361+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:41:30.447760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20787709200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":368,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"56'51","reported_seq":150,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.082811+0000","last_change":"2024-08-31T12:21:55.082811+0000","last_active":"2024-08-31T12:21:55.082811+0000","last_peered":"2024-08-31T12:21:55.082811+0000","last_clean":"2024-08-31T12:21:55.082811+0000","last_became_active":"2024-08-31T12:13:45.672766+0000","last_became_peered":"2024-08-31T12:13:45.672766+0000","last_unstale":"2024-08-31T12:21:55.082811+0000","last_undegraded":"2024-08-31T12:21:55.082811+0000","last_fullsized":"2024-08-31T12:21:55.082811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'51","last_scrub_stamp":"2024-08-31T12:21:55.082728+0000","last_deep_scrub":"56'51","last_deep_scrub_stamp":"2024-08-31T12:21:55.082728+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.082728+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:58.433488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":48,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"56'88","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.938683+0000","last_change":"2024-08-31T12:22:07.938683+0000","last_active":"2024-08-31T12:22:07.938683+0000","last_peered":"2024-08-31T12:22:07.938683+0000","last_clean":"2024-08-31T12:22:07.938683+0000","last_became_active":"2024-08-31T12:13:46.683907+0000","last_became_peered":"2024-08-31T12:13:46.683907+0000","last_unstale":"2024-08-31T12:22:07.938683+0000","last_undegraded":"2024-08-31T12:22:07.938683+0000","last_fullsized":"2024-08-31T12:22:07.938683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:22:07.938601+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:22:07.938601+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.938601+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:18:15.196547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21620699299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"56'334","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.468390+0000","last_change":"2024-08-31T12:22:03.468390+0000","last_active":"2024-08-31T12:22:03.468390+0000","last_peered":"2024-08-31T12:22:03.468390+0000","last_clean":"2024-08-31T12:22:03.468390+0000","last_became_active":"2024-08-31T12:13:50.755154+0000","last_became_peered":"2024-08-31T12:13:50.755154+0000","last_unstale":"2024-08-31T12:22:03.468390+0000","last_undegraded":"2024-08-31T12:22:03.468390+0000","last_fullsized":"2024-08-31T12:22:03.468390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'334","last_scrub_stamp":"2024-08-31T12:22:03.468285+0000","last_deep_scrub":"56'334","last_deep_scrub_stamp":"2024-08-31T12:22:03.468285+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.468285+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:29.945194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22135840800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":334,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"56'88","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.887705+0000","last_change":"2024-08-31T12:21:59.887581+0000","last_active":"2024-08-31T12:21:59.887705+0000","last_peered":"2024-08-31T12:21:59.887705+0000","last_clean":"2024-08-31T12:21:59.887705+0000","last_became_active":"2024-08-31T12:13:46.675185+0000","last_became_peered":"2024-08-31T12:13:46.675185+0000","last_unstale":"2024-08-31T12:21:59.887705+0000","last_undegraded":"2024-08-31T12:21:59.887705+0000","last_fullsized":"2024-08-31T12:21:59.887705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:21:59.887465+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:21:59.887465+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.887465+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:38:22.769942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21210352199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"56'89","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.930476+0000","last_change":"2024-08-31T12:21:54.930476+0000","last_active":"2024-08-31T12:21:54.930476+0000","last_peered":"2024-08-31T12:21:54.930476+0000","last_clean":"2024-08-31T12:21:54.930476+0000","last_became_active":"2024-08-31T12:13:45.666839+0000","last_became_peered":"2024-08-31T12:13:45.666839+0000","last_unstale":"2024-08-31T12:21:54.930476+0000","last_undegraded":"2024-08-31T12:21:54.930476+0000","last_fullsized":"2024-08-31T12:21:54.930476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:54.930376+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:54.930376+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.930376+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:50.056222+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28680,"num_write":79,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"56'339","reported_seq":2488,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.012744+0000","last_change":"2024-08-31T12:22:07.012744+0000","last_active":"2024-08-31T12:22:07.012744+0000","last_peered":"2024-08-31T12:22:07.012744+0000","last_clean":"2024-08-31T12:22:07.012744+0000","last_became_active":"2024-08-31T12:14:28.094469+0000","last_became_peered":"2024-08-31T12:14:28.094469+0000","last_unstale":"2024-08-31T12:22:07.012744+0000","last_undegraded":"2024-08-31T12:22:07.012744+0000","last_fullsized":"2024-08-31T12:22:07.012744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'339","last_scrub_stamp":"2024-08-31T12:22:07.012655+0000","last_deep_scrub":"56'339","last_deep_scrub_stamp":"2024-08-31T12:22:07.012655+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.012655+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:18:32.622736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072156433000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":4130,"num_write":338,"num_write_kb":24739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"56'89","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.857840+0000","last_change":"2024-08-31T12:21:56.857840+0000","last_active":"2024-08-31T12:21:56.857840+0000","last_peered":"2024-08-31T12:21:56.857840+0000","last_clean":"2024-08-31T12:21:56.857840+0000","last_became_active":"2024-08-31T12:13:46.699008+0000","last_became_peered":"2024-08-31T12:13:46.699008+0000","last_unstale":"2024-08-31T12:21:56.857840+0000","last_undegraded":"2024-08-31T12:21:56.857840+0000","last_fullsized":"2024-08-31T12:21:56.857840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:56.857648+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:56.857648+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.857648+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:27:23.716810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14785688799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"56'24","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.607711+0000","last_change":"2024-08-31T12:21:52.607551+0000","last_active":"2024-08-31T12:21:52.607711+0000","last_peered":"2024-08-31T12:21:52.607711+0000","last_clean":"2024-08-31T12:21:52.607711+0000","last_became_active":"2024-08-31T12:13:45.691179+0000","last_became_peered":"2024-08-31T12:13:45.691179+0000","last_unstale":"2024-08-31T12:21:52.607711+0000","last_undegraded":"2024-08-31T12:21:52.607711+0000","last_fullsized":"2024-08-31T12:21:52.607711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-08-31T12:21:52.607289+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-08-31T12:21:52.607289+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.607289+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:14:24.910359+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"56'363","reported_seq":2515,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.985422+0000","last_change":"2024-08-31T12:22:04.985422+0000","last_active":"2024-08-31T12:22:04.985422+0000","last_peered":"2024-08-31T12:22:04.985422+0000","last_clean":"2024-08-31T12:22:04.985422+0000","last_became_active":"2024-08-31T12:13:50.738256+0000","last_became_peered":"2024-08-31T12:13:50.738256+0000","last_unstale":"2024-08-31T12:22:04.985422+0000","last_undegraded":"2024-08-31T12:22:04.985422+0000","last_fullsized":"2024-08-31T12:22:04.985422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'363","last_scrub_stamp":"2024-08-31T12:22:04.985327+0000","last_deep_scrub":"56'363","last_deep_scrub_stamp":"2024-08-31T12:22:04.985327+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.985327+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:58:04.436708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072494041999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":4130,"num_write":360,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"56'93","reported_seq":2216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.815590+0000","last_change":"2024-08-31T12:22:00.815301+0000","last_active":"2024-08-31T12:22:00.815590+0000","last_peered":"2024-08-31T12:22:00.815590+0000","last_clean":"2024-08-31T12:22:00.815590+0000","last_became_active":"2024-08-31T12:13:46.697571+0000","last_became_peered":"2024-08-31T12:13:46.697571+0000","last_unstale":"2024-08-31T12:22:00.815590+0000","last_undegraded":"2024-08-31T12:22:00.815590+0000","last_fullsized":"2024-08-31T12:22:00.815590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:00.814984+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:00.814984+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.814984+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:51.666514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18948480700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'96","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.853500+0000","last_change":"2024-08-31T12:21:52.726168+0000","last_active":"2024-08-31T12:22:00.853500+0000","last_peered":"2024-08-31T12:22:00.853500+0000","last_clean":"2024-08-31T12:22:00.853500+0000","last_became_active":"2024-08-31T12:13:45.683052+0000","last_became_peered":"2024-08-31T12:13:45.683052+0000","last_unstale":"2024-08-31T12:22:00.853500+0000","last_undegraded":"2024-08-31T12:22:00.853500+0000","last_fullsized":"2024-08-31T12:22:00.853500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'95","last_scrub_stamp":"2024-08-31T12:21:52.725978+0000","last_deep_scrub":"56'95","last_deep_scrub_stamp":"2024-08-31T12:21:52.725978+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.725978+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:07:31.496201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535621,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":481,"num_write":92,"num_write_kb":1564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"56'336","reported_seq":2495,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.893561+0000","last_change":"2024-08-31T12:21:57.893561+0000","last_active":"2024-08-31T12:21:57.893561+0000","last_peered":"2024-08-31T12:21:57.893561+0000","last_clean":"2024-08-31T12:21:57.893561+0000","last_became_active":"2024-08-31T12:13:50.754916+0000","last_became_peered":"2024-08-31T12:13:50.754916+0000","last_unstale":"2024-08-31T12:21:57.893561+0000","last_undegraded":"2024-08-31T12:21:57.893561+0000","last_fullsized":"2024-08-31T12:21:57.893561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'336","last_scrub_stamp":"2024-08-31T12:21:57.893365+0000","last_deep_scrub":"56'336","last_deep_scrub_stamp":"2024-08-31T12:21:57.893365+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.893365+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:46:18.618446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.14802904,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":8232,"num_write":332,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'94","reported_seq":2216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.911642+0000","last_change":"2024-08-31T12:21:55.911534+0000","last_active":"2024-08-31T12:21:55.911642+0000","last_peered":"2024-08-31T12:21:55.911642+0000","last_clean":"2024-08-31T12:21:55.911642+0000","last_became_active":"2024-08-31T12:13:46.688093+0000","last_became_peered":"2024-08-31T12:13:46.688093+0000","last_unstale":"2024-08-31T12:21:55.911642+0000","last_undegraded":"2024-08-31T12:21:55.911642+0000","last_fullsized":"2024-08-31T12:21:55.911642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'94","last_scrub_stamp":"2024-08-31T12:21:55.911444+0000","last_deep_scrub":"56'94","last_deep_scrub_stamp":"2024-08-31T12:21:55.911444+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.911444+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:18.245824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20941357199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"56'9","reported_seq":104,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.089237+0000","last_change":"2024-08-31T12:21:50.089124+0000","last_active":"2024-08-31T12:21:50.089237+0000","last_peered":"2024-08-31T12:21:50.089237+0000","last_clean":"2024-08-31T12:21:50.089237+0000","last_became_active":"2024-08-31T12:13:45.670942+0000","last_became_peered":"2024-08-31T12:13:45.670942+0000","last_unstale":"2024-08-31T12:21:50.089237+0000","last_undegraded":"2024-08-31T12:21:50.089237+0000","last_fullsized":"2024-08-31T12:21:50.089237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'9","last_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_deep_scrub":"56'9","last_deep_scrub_stamp":"2024-08-31T12:21:50.089039+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.089039+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:08:59.686158+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"56'286","reported_seq":2442,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.453299+0000","last_change":"2024-08-31T12:21:58.453299+0000","last_active":"2024-08-31T12:21:58.453299+0000","last_peered":"2024-08-31T12:21:58.453299+0000","last_clean":"2024-08-31T12:21:58.453299+0000","last_became_active":"2024-08-31T12:13:50.755992+0000","last_became_peered":"2024-08-31T12:13:50.755992+0000","last_unstale":"2024-08-31T12:21:58.453299+0000","last_undegraded":"2024-08-31T12:21:58.453299+0000","last_fullsized":"2024-08-31T12:21:58.453299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'286","last_scrub_stamp":"2024-08-31T12:21:58.453210+0000","last_deep_scrub":"56'286","last_deep_scrub_stamp":"2024-08-31T12:21:58.453210+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.453210+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:19.834451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.187709866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":4132,"num_write":284,"num_write_kb":20569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"56'93","reported_seq":2216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.758095+0000","last_change":"2024-08-31T12:21:56.757939+0000","last_active":"2024-08-31T12:21:56.758095+0000","last_peered":"2024-08-31T12:21:56.758095+0000","last_clean":"2024-08-31T12:21:56.758095+0000","last_became_active":"2024-08-31T12:13:46.708080+0000","last_became_peered":"2024-08-31T12:13:46.708080+0000","last_unstale":"2024-08-31T12:21:56.758095+0000","last_undegraded":"2024-08-31T12:21:56.758095+0000","last_fullsized":"2024-08-31T12:21:56.758095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:21:56.757738+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:21:56.757738+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.757738+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:42.279618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.187917158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"56'10","reported_seq":107,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.864953+0000","last_change":"2024-08-31T12:21:52.864893+0000","last_active":"2024-08-31T12:21:52.864953+0000","last_peered":"2024-08-31T12:21:52.864953+0000","last_clean":"2024-08-31T12:21:52.864953+0000","last_became_active":"2024-08-31T12:13:45.674636+0000","last_became_peered":"2024-08-31T12:13:45.674636+0000","last_unstale":"2024-08-31T12:21:52.864953+0000","last_undegraded":"2024-08-31T12:21:52.864953+0000","last_fullsized":"2024-08-31T12:21:52.864953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'10","last_scrub_stamp":"2024-08-31T12:21:52.864819+0000","last_deep_scrub":"56'10","last_deep_scrub_stamp":"2024-08-31T12:21:52.864819+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.864819+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:28:50.885753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"56'362","reported_seq":2512,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.432763+0000","last_change":"2024-08-31T12:21:59.432694+0000","last_active":"2024-08-31T12:21:59.432763+0000","last_peered":"2024-08-31T12:21:59.432763+0000","last_clean":"2024-08-31T12:21:59.432763+0000","last_became_active":"2024-08-31T12:13:50.731758+0000","last_became_peered":"2024-08-31T12:13:50.731758+0000","last_unstale":"2024-08-31T12:21:59.432763+0000","last_undegraded":"2024-08-31T12:21:59.432763+0000","last_fullsized":"2024-08-31T12:21:59.432763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'362","last_scrub_stamp":"2024-08-31T12:21:59.432592+0000","last_deep_scrub":"56'362","last_deep_scrub_stamp":"2024-08-31T12:21:59.432592+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.432592+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:01.624681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20764284999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":28,"num_write":360,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"56'88","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.771236+0000","last_change":"2024-08-31T12:21:58.771055+0000","last_active":"2024-08-31T12:21:58.771236+0000","last_peered":"2024-08-31T12:21:58.771236+0000","last_clean":"2024-08-31T12:21:58.771236+0000","last_became_active":"2024-08-31T12:13:46.698832+0000","last_became_peered":"2024-08-31T12:13:46.698832+0000","last_unstale":"2024-08-31T12:21:58.771236+0000","last_undegraded":"2024-08-31T12:21:58.771236+0000","last_fullsized":"2024-08-31T12:21:58.771236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'88","last_scrub_stamp":"2024-08-31T12:21:58.770867+0000","last_deep_scrub":"56'88","last_deep_scrub_stamp":"2024-08-31T12:21:58.770867+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.770867+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:12:20.157465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18409045900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"56'170","reported_seq":269,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.697343+0000","last_change":"2024-08-31T12:21:51.697023+0000","last_active":"2024-08-31T12:21:51.697343+0000","last_peered":"2024-08-31T12:21:51.697343+0000","last_clean":"2024-08-31T12:21:51.697343+0000","last_became_active":"2024-08-31T12:13:45.683494+0000","last_became_peered":"2024-08-31T12:13:45.683494+0000","last_unstale":"2024-08-31T12:21:51.697343+0000","last_undegraded":"2024-08-31T12:21:51.697343+0000","last_fullsized":"2024-08-31T12:21:51.697343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'170","last_scrub_stamp":"2024-08-31T12:21:51.696710+0000","last_deep_scrub":"56'170","last_deep_scrub_stamp":"2024-08-31T12:21:51.696710+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.696710+0000","objects_scrubbed":1,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:25.908125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":159,"num_write":414,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"56'358","reported_seq":2524,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.786323+0000","last_change":"2024-08-31T12:22:03.786323+0000","last_active":"2024-08-31T12:22:03.786323+0000","last_peered":"2024-08-31T12:22:03.786323+0000","last_clean":"2024-08-31T12:22:03.786323+0000","last_became_active":"2024-08-31T12:13:50.740235+0000","last_became_peered":"2024-08-31T12:13:50.740235+0000","last_unstale":"2024-08-31T12:22:03.786323+0000","last_undegraded":"2024-08-31T12:22:03.786323+0000","last_fullsized":"2024-08-31T12:22:03.786323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'358","last_scrub_stamp":"2024-08-31T12:22:03.786128+0000","last_deep_scrub":"56'358","last_deep_scrub_stamp":"2024-08-31T12:22:03.786128+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.786128+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:42:34.748565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.19115578499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":356,"num_write_kb":20654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"56'90","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.512266+0000","last_change":"2024-08-31T12:21:56.512092+0000","last_active":"2024-08-31T12:21:56.512266+0000","last_peered":"2024-08-31T12:21:56.512266+0000","last_clean":"2024-08-31T12:21:56.512266+0000","last_became_active":"2024-08-31T12:13:46.706065+0000","last_became_peered":"2024-08-31T12:13:46.706065+0000","last_unstale":"2024-08-31T12:21:56.512266+0000","last_undegraded":"2024-08-31T12:21:56.512266+0000","last_fullsized":"2024-08-31T12:21:56.512266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:56.511890+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:56.511890+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.511890+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:25.651388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.107650158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"56'24","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.965638+0000","last_change":"2024-08-31T12:21:56.965564+0000","last_active":"2024-08-31T12:21:56.965638+0000","last_peered":"2024-08-31T12:21:56.965638+0000","last_clean":"2024-08-31T12:21:56.965638+0000","last_became_active":"2024-08-31T12:13:45.682545+0000","last_became_peered":"2024-08-31T12:13:45.682545+0000","last_unstale":"2024-08-31T12:21:56.965638+0000","last_undegraded":"2024-08-31T12:21:56.965638+0000","last_fullsized":"2024-08-31T12:21:56.965638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'24","last_scrub_stamp":"2024-08-31T12:21:56.965444+0000","last_deep_scrub":"56'24","last_deep_scrub_stamp":"2024-08-31T12:21:56.965444+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.965444+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:51:54.400966+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"56'374","reported_seq":2528,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.656202+0000","last_change":"2024-08-31T12:22:04.656032+0000","last_active":"2024-08-31T12:22:04.656202+0000","last_peered":"2024-08-31T12:22:04.656202+0000","last_clean":"2024-08-31T12:22:04.656202+0000","last_became_active":"2024-08-31T12:13:50.754976+0000","last_became_peered":"2024-08-31T12:13:50.754976+0000","last_unstale":"2024-08-31T12:22:04.656202+0000","last_undegraded":"2024-08-31T12:22:04.656202+0000","last_fullsized":"2024-08-31T12:22:04.656202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'374","last_scrub_stamp":"2024-08-31T12:22:04.655838+0000","last_deep_scrub":"56'374","last_deep_scrub_stamp":"2024-08-31T12:22:04.655838+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.655838+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:56:22.888721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.121036924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":32,"num_write":374,"num_write_kb":20662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"56'83","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.500666+0000","last_change":"2024-08-31T12:21:51.500560+0000","last_active":"2024-08-31T12:21:51.500666+0000","last_peered":"2024-08-31T12:21:51.500666+0000","last_clean":"2024-08-31T12:21:51.500666+0000","last_became_active":"2024-08-31T12:13:46.663310+0000","last_became_peered":"2024-08-31T12:13:46.663310+0000","last_unstale":"2024-08-31T12:21:51.500666+0000","last_undegraded":"2024-08-31T12:21:51.500666+0000","last_fullsized":"2024-08-31T12:21:51.500666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:21:51.500469+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:21:51.500469+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.500469+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:29:27.720371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20764785499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"56'3","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.915882+0000","last_change":"2024-08-31T12:21:51.915704+0000","last_active":"2024-08-31T12:21:51.915882+0000","last_peered":"2024-08-31T12:21:51.915882+0000","last_clean":"2024-08-31T12:21:51.915882+0000","last_became_active":"2024-08-31T12:13:45.694215+0000","last_became_peered":"2024-08-31T12:13:45.694215+0000","last_unstale":"2024-08-31T12:21:51.915882+0000","last_undegraded":"2024-08-31T12:21:51.915882+0000","last_fullsized":"2024-08-31T12:21:51.915882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-08-31T12:21:51.915487+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-08-31T12:21:51.915487+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.915487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:42.465333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"56'353","reported_seq":2505,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.588373+0000","last_change":"2024-08-31T12:22:02.588076+0000","last_active":"2024-08-31T12:22:02.588373+0000","last_peered":"2024-08-31T12:22:02.588373+0000","last_clean":"2024-08-31T12:22:02.588373+0000","last_became_active":"2024-08-31T12:13:50.768277+0000","last_became_peered":"2024-08-31T12:13:50.768277+0000","last_unstale":"2024-08-31T12:22:02.588373+0000","last_undegraded":"2024-08-31T12:22:02.588373+0000","last_fullsized":"2024-08-31T12:22:02.588373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'353","last_scrub_stamp":"2024-08-31T12:22:02.587749+0000","last_deep_scrub":"56'353","last_deep_scrub_stamp":"2024-08-31T12:22:02.587749+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.587749+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:45.386162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12982363399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":34,"num_write":352,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"56'97","reported_seq":2219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.108644+0000","last_change":"2024-08-31T12:21:52.108591+0000","last_active":"2024-08-31T12:21:52.108644+0000","last_peered":"2024-08-31T12:21:52.108644+0000","last_clean":"2024-08-31T12:21:52.108644+0000","last_became_active":"2024-08-31T12:13:46.661098+0000","last_became_peered":"2024-08-31T12:13:46.661098+0000","last_unstale":"2024-08-31T12:21:52.108644+0000","last_undegraded":"2024-08-31T12:21:52.108644+0000","last_fullsized":"2024-08-31T12:21:52.108644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:21:52.108515+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:21:52.108515+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.108515+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:42:55.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071105529000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"56'169","reported_seq":267,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.850092+0000","last_change":"2024-08-31T12:21:50.850019+0000","last_active":"2024-08-31T12:21:50.850092+0000","last_peered":"2024-08-31T12:21:50.850092+0000","last_clean":"2024-08-31T12:21:50.850092+0000","last_became_active":"2024-08-31T12:13:45.690679+0000","last_became_peered":"2024-08-31T12:13:45.690679+0000","last_unstale":"2024-08-31T12:21:50.850092+0000","last_undegraded":"2024-08-31T12:21:50.850092+0000","last_fullsized":"2024-08-31T12:21:50.850092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'169","last_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_deep_scrub":"56'169","last_deep_scrub_stamp":"2024-08-31T12:21:50.849945+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.849945+0000","objects_scrubbed":2,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:49.571172+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":164,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"56'320","reported_seq":2466,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.622588+0000","last_change":"2024-08-31T12:22:03.622417+0000","last_active":"2024-08-31T12:22:03.622588+0000","last_peered":"2024-08-31T12:22:03.622588+0000","last_clean":"2024-08-31T12:22:03.622588+0000","last_became_active":"2024-08-31T12:13:50.757763+0000","last_became_peered":"2024-08-31T12:13:50.757763+0000","last_unstale":"2024-08-31T12:22:03.622588+0000","last_undegraded":"2024-08-31T12:22:03.622588+0000","last_fullsized":"2024-08-31T12:22:03.622588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'320","last_scrub_stamp":"2024-08-31T12:22:03.622216+0000","last_deep_scrub":"56'320","last_deep_scrub_stamp":"2024-08-31T12:22:03.622216+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.622216+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:07:46.585770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.109792995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3300,"num_write":320,"num_write_kb":11627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"56'83","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.870741+0000","last_change":"2024-08-31T12:21:54.870741+0000","last_active":"2024-08-31T12:21:54.870741+0000","last_peered":"2024-08-31T12:21:54.870741+0000","last_clean":"2024-08-31T12:21:54.870741+0000","last_became_active":"2024-08-31T12:13:46.704094+0000","last_became_peered":"2024-08-31T12:13:46.704094+0000","last_unstale":"2024-08-31T12:21:54.870741+0000","last_undegraded":"2024-08-31T12:21:54.870741+0000","last_fullsized":"2024-08-31T12:21:54.870741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:21:54.870546+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:21:54.870546+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.870546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:52.525819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.221163634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"56'146","reported_seq":384,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.899450+0000","last_change":"2024-08-31T12:21:52.899251+0000","last_active":"2024-08-31T12:21:52.899450+0000","last_peered":"2024-08-31T12:21:52.899450+0000","last_clean":"2024-08-31T12:21:52.899450+0000","last_became_active":"2024-08-31T12:13:45.689834+0000","last_became_peered":"2024-08-31T12:13:45.689834+0000","last_unstale":"2024-08-31T12:21:52.899450+0000","last_undegraded":"2024-08-31T12:21:52.899450+0000","last_fullsized":"2024-08-31T12:21:52.899450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'146","last_scrub_stamp":"2024-08-31T12:21:52.898947+0000","last_deep_scrub":"56'146","last_deep_scrub_stamp":"2024-08-31T12:21:52.898947+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.898947+0000","objects_scrubbed":1,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:13:34.531866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":579228,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":146,"num_read_kb":661,"num_write":141,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"56'331","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.652157+0000","last_change":"2024-08-31T12:22:05.651987+0000","last_active":"2024-08-31T12:22:05.652157+0000","last_peered":"2024-08-31T12:22:05.652157+0000","last_clean":"2024-08-31T12:22:05.652157+0000","last_became_active":"2024-08-31T12:13:50.768339+0000","last_became_peered":"2024-08-31T12:13:50.768339+0000","last_unstale":"2024-08-31T12:22:05.652157+0000","last_undegraded":"2024-08-31T12:22:05.652157+0000","last_fullsized":"2024-08-31T12:22:05.652157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'331","last_scrub_stamp":"2024-08-31T12:22:05.651778+0000","last_deep_scrub":"56'331","last_deep_scrub_stamp":"2024-08-31T12:22:05.651778+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.651778+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:24:29.289146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.103310548,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":330,"num_write_kb":8355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"56'82","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.523993+0000","last_change":"2024-08-31T12:21:55.523820+0000","last_active":"2024-08-31T12:21:55.523993+0000","last_peered":"2024-08-31T12:21:55.523993+0000","last_clean":"2024-08-31T12:21:55.523993+0000","last_became_active":"2024-08-31T12:13:46.665206+0000","last_became_peered":"2024-08-31T12:13:46.665206+0000","last_unstale":"2024-08-31T12:21:55.523993+0000","last_undegraded":"2024-08-31T12:21:55.523993+0000","last_fullsized":"2024-08-31T12:21:55.523993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'82","last_scrub_stamp":"2024-08-31T12:21:55.523624+0000","last_deep_scrub":"56'82","last_deep_scrub_stamp":"2024-08-31T12:21:55.523624+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.523624+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:40.887584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.11272175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"56'103","reported_seq":203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.969002+0000","last_change":"2024-08-31T12:22:01.969002+0000","last_active":"2024-08-31T12:22:01.969002+0000","last_peered":"2024-08-31T12:22:01.969002+0000","last_clean":"2024-08-31T12:22:01.969002+0000","last_became_active":"2024-08-31T12:13:45.676513+0000","last_became_peered":"2024-08-31T12:13:45.676513+0000","last_unstale":"2024-08-31T12:22:01.969002+0000","last_undegraded":"2024-08-31T12:22:01.969002+0000","last_fullsized":"2024-08-31T12:22:01.969002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'103","last_scrub_stamp":"2024-08-31T12:22:01.968903+0000","last_deep_scrub":"56'103","last_deep_scrub_stamp":"2024-08-31T12:22:01.968903+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.968903+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:28:17.530329+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":92,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'365","reported_seq":2526,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.874624+0000","last_change":"2024-08-31T12:22:07.874348+0000","last_active":"2024-08-31T12:22:07.874624+0000","last_peered":"2024-08-31T12:22:07.874624+0000","last_clean":"2024-08-31T12:22:07.874624+0000","last_became_active":"2024-08-31T12:13:50.765939+0000","last_became_peered":"2024-08-31T12:13:50.765939+0000","last_unstale":"2024-08-31T12:22:07.874624+0000","last_undegraded":"2024-08-31T12:22:07.874624+0000","last_fullsized":"2024-08-31T12:22:07.874624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'365","last_scrub_stamp":"2024-08-31T12:22:07.874105+0000","last_deep_scrub":"44'365","last_deep_scrub_stamp":"2024-08-31T12:22:07.874105+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.874105+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:55.138503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22991697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":359,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"56'91","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.778087+0000","last_change":"2024-08-31T12:21:57.777825+0000","last_active":"2024-08-31T12:21:57.778087+0000","last_peered":"2024-08-31T12:21:57.778087+0000","last_clean":"2024-08-31T12:21:57.778087+0000","last_became_active":"2024-08-31T12:13:46.690223+0000","last_became_peered":"2024-08-31T12:13:46.690223+0000","last_unstale":"2024-08-31T12:21:57.778087+0000","last_undegraded":"2024-08-31T12:21:57.778087+0000","last_fullsized":"2024-08-31T12:21:57.778087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'91","last_scrub_stamp":"2024-08-31T12:21:57.777575+0000","last_deep_scrub":"56'91","last_deep_scrub_stamp":"2024-08-31T12:21:57.777575+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.777575+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:25.267522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18420207799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"56'5","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.857163+0000","last_change":"2024-08-31T12:21:51.857090+0000","last_active":"2024-08-31T12:21:51.857163+0000","last_peered":"2024-08-31T12:21:51.857163+0000","last_clean":"2024-08-31T12:21:51.857163+0000","last_became_active":"2024-08-31T12:13:45.662256+0000","last_became_peered":"2024-08-31T12:13:45.662256+0000","last_unstale":"2024-08-31T12:21:51.857163+0000","last_undegraded":"2024-08-31T12:21:51.857163+0000","last_fullsized":"2024-08-31T12:21:51.857163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5","last_scrub_stamp":"2024-08-31T12:21:51.857016+0000","last_deep_scrub":"56'5","last_deep_scrub_stamp":"2024-08-31T12:21:51.857016+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.857016+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:28:21.259871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"56'74","reported_seq":190,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.599874+0000","last_change":"2024-08-31T12:21:52.599874+0000","last_active":"2024-08-31T12:21:52.599874+0000","last_peered":"2024-08-31T12:21:52.599874+0000","last_clean":"2024-08-31T12:21:52.599874+0000","last_became_active":"2024-08-31T12:13:38.542938+0000","last_became_peered":"2024-08-31T12:13:38.542938+0000","last_unstale":"2024-08-31T12:21:52.599874+0000","last_undegraded":"2024-08-31T12:21:52.599874+0000","last_fullsized":"2024-08-31T12:21:52.599874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74","last_scrub_stamp":"2024-08-31T12:21:52.599797+0000","last_deep_scrub":"56'74","last_deep_scrub_stamp":"2024-08-31T12:21:52.599797+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.599797+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:06.404675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'299","reported_seq":2449,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:09.959567+0000","last_change":"2024-08-31T12:22:09.959469+0000","last_active":"2024-08-31T12:22:09.959567+0000","last_peered":"2024-08-31T12:22:09.959567+0000","last_clean":"2024-08-31T12:22:09.959567+0000","last_became_active":"2024-08-31T12:13:50.721382+0000","last_became_peered":"2024-08-31T12:13:50.721382+0000","last_unstale":"2024-08-31T12:22:09.959567+0000","last_undegraded":"2024-08-31T12:22:09.959567+0000","last_fullsized":"2024-08-31T12:22:09.959567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'299","last_scrub_stamp":"2024-08-31T12:22:09.959313+0000","last_deep_scrub":"56'299","last_deep_scrub_stamp":"2024-08-31T12:22:09.959313+0000","last_clean_scrub_stamp":"2024-08-31T12:22:09.959313+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:10:32.460754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21461216899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":298,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"56'93","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.932381+0000","last_change":"2024-08-31T12:21:58.932381+0000","last_active":"2024-08-31T12:21:58.932381+0000","last_peered":"2024-08-31T12:21:58.932381+0000","last_clean":"2024-08-31T12:21:58.932381+0000","last_became_active":"2024-08-31T12:13:46.682073+0000","last_became_peered":"2024-08-31T12:13:46.682073+0000","last_unstale":"2024-08-31T12:21:58.932381+0000","last_undegraded":"2024-08-31T12:21:58.932381+0000","last_fullsized":"2024-08-31T12:21:58.932381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:21:58.932299+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:21:58.932299+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.932299+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:10.950683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21248973199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"55'3","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.589285+0000","last_change":"2024-08-31T12:21:53.589285+0000","last_active":"2024-08-31T12:21:53.589285+0000","last_peered":"2024-08-31T12:21:53.589285+0000","last_clean":"2024-08-31T12:21:53.589285+0000","last_became_active":"2024-08-31T12:13:45.696004+0000","last_became_peered":"2024-08-31T12:13:45.696004+0000","last_unstale":"2024-08-31T12:21:53.589285+0000","last_undegraded":"2024-08-31T12:21:53.589285+0000","last_fullsized":"2024-08-31T12:21:53.589285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2024-08-31T12:21:53.588909+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2024-08-31T12:21:53.588909+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.588909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:13:33.403839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"56'346","reported_seq":2495,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.467681+0000","last_change":"2024-08-31T12:22:00.467548+0000","last_active":"2024-08-31T12:22:00.467681+0000","last_peered":"2024-08-31T12:22:00.467681+0000","last_clean":"2024-08-31T12:22:00.467681+0000","last_became_active":"2024-08-31T12:13:50.750817+0000","last_became_peered":"2024-08-31T12:13:50.750817+0000","last_unstale":"2024-08-31T12:22:00.467681+0000","last_undegraded":"2024-08-31T12:22:00.467681+0000","last_fullsized":"2024-08-31T12:22:00.467681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'346","last_scrub_stamp":"2024-08-31T12:22:00.467431+0000","last_deep_scrub":"56'346","last_deep_scrub_stamp":"2024-08-31T12:22:00.467431+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.467431+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:09:57.989807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21993294799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":344,"num_write_kb":12461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"56'97","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.090781+0000","last_change":"2024-08-31T12:21:57.090781+0000","last_active":"2024-08-31T12:21:57.090781+0000","last_peered":"2024-08-31T12:21:57.090781+0000","last_clean":"2024-08-31T12:21:57.090781+0000","last_became_active":"2024-08-31T12:13:46.677084+0000","last_became_peered":"2024-08-31T12:13:46.677084+0000","last_unstale":"2024-08-31T12:21:57.090781+0000","last_undegraded":"2024-08-31T12:21:57.090781+0000","last_fullsized":"2024-08-31T12:21:57.090781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:21:57.090678+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:21:57.090678+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.090678+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:43:15.144725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072560660999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"56'23","reported_seq":122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.910223+0000","last_change":"2024-08-31T12:21:52.910223+0000","last_active":"2024-08-31T12:21:52.910223+0000","last_peered":"2024-08-31T12:21:52.910223+0000","last_clean":"2024-08-31T12:21:52.910223+0000","last_became_active":"2024-08-31T12:13:45.686116+0000","last_became_peered":"2024-08-31T12:13:45.686116+0000","last_unstale":"2024-08-31T12:21:52.910223+0000","last_undegraded":"2024-08-31T12:21:52.910223+0000","last_fullsized":"2024-08-31T12:21:52.910223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'23","last_scrub_stamp":"2024-08-31T12:21:52.909962+0000","last_deep_scrub":"56'23","last_deep_scrub_stamp":"2024-08-31T12:21:52.909962+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.909962+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:22.287929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":21,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"56'324","reported_seq":2479,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:08.903046+0000","last_change":"2024-08-31T12:22:08.903046+0000","last_active":"2024-08-31T12:22:08.903046+0000","last_peered":"2024-08-31T12:22:08.903046+0000","last_clean":"2024-08-31T12:22:08.903046+0000","last_became_active":"2024-08-31T12:13:50.735514+0000","last_became_peered":"2024-08-31T12:13:50.735514+0000","last_unstale":"2024-08-31T12:22:08.903046+0000","last_undegraded":"2024-08-31T12:22:08.903046+0000","last_fullsized":"2024-08-31T12:22:08.903046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'324","last_scrub_stamp":"2024-08-31T12:22:08.902839+0000","last_deep_scrub":"56'324","last_deep_scrub_stamp":"2024-08-31T12:22:08.902839+0000","last_clean_scrub_stamp":"2024-08-31T12:22:08.902839+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:10.806727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23306870700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":36,"num_write":324,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"56'87","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.105633+0000","last_change":"2024-08-31T12:21:59.105633+0000","last_active":"2024-08-31T12:21:59.105633+0000","last_peered":"2024-08-31T12:21:59.105633+0000","last_clean":"2024-08-31T12:21:59.105633+0000","last_became_active":"2024-08-31T12:13:46.661605+0000","last_became_peered":"2024-08-31T12:13:46.661605+0000","last_unstale":"2024-08-31T12:21:59.105633+0000","last_undegraded":"2024-08-31T12:21:59.105633+0000","last_fullsized":"2024-08-31T12:21:59.105633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:21:59.105523+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:21:59.105523+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.105523+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:26.797289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072244931999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"56'109","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.702818+0000","last_change":"2024-08-31T12:21:53.702818+0000","last_active":"2024-08-31T12:21:53.702818+0000","last_peered":"2024-08-31T12:21:53.702818+0000","last_clean":"2024-08-31T12:21:53.702818+0000","last_became_active":"2024-08-31T12:13:45.695697+0000","last_became_peered":"2024-08-31T12:13:45.695697+0000","last_unstale":"2024-08-31T12:21:53.702818+0000","last_undegraded":"2024-08-31T12:21:53.702818+0000","last_fullsized":"2024-08-31T12:21:53.702818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:53.702608+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:53.702608+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.702608+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:55:53.145552+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":106,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"56'346","reported_seq":2497,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:12.944270+0000","last_change":"2024-08-31T12:22:12.944204+0000","last_active":"2024-08-31T12:22:12.944270+0000","last_peered":"2024-08-31T12:22:12.944270+0000","last_clean":"2024-08-31T12:22:12.944270+0000","last_became_active":"2024-08-31T12:13:50.743225+0000","last_became_peered":"2024-08-31T12:13:50.743225+0000","last_unstale":"2024-08-31T12:22:12.944270+0000","last_undegraded":"2024-08-31T12:22:12.944270+0000","last_fullsized":"2024-08-31T12:22:12.944270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'346","last_scrub_stamp":"2024-08-31T12:22:12.944117+0000","last_deep_scrub":"56'346","last_deep_scrub_stamp":"2024-08-31T12:22:12.944117+0000","last_clean_scrub_stamp":"2024-08-31T12:22:12.944117+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:08:46.135229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21677952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":32,"num_write":346,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"56'65","reported_seq":2187,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.475443+0000","last_change":"2024-08-31T12:21:50.475443+0000","last_active":"2024-08-31T12:21:50.475443+0000","last_peered":"2024-08-31T12:21:50.475443+0000","last_clean":"2024-08-31T12:21:50.475443+0000","last_became_active":"2024-08-31T12:13:46.662511+0000","last_became_peered":"2024-08-31T12:13:46.662511+0000","last_unstale":"2024-08-31T12:21:50.475443+0000","last_undegraded":"2024-08-31T12:21:50.475443+0000","last_fullsized":"2024-08-31T12:21:50.475443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'65","last_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_deep_scrub":"56'65","last_deep_scrub_stamp":"2024-08-31T12:21:50.475366+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.475366+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:32.691010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18743860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"56'21","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.094777+0000","last_change":"2024-08-31T12:21:53.094777+0000","last_active":"2024-08-31T12:21:53.094777+0000","last_peered":"2024-08-31T12:21:53.094777+0000","last_clean":"2024-08-31T12:21:53.094777+0000","last_became_active":"2024-08-31T12:13:45.685975+0000","last_became_peered":"2024-08-31T12:13:45.685975+0000","last_unstale":"2024-08-31T12:21:53.094777+0000","last_undegraded":"2024-08-31T12:21:53.094777+0000","last_fullsized":"2024-08-31T12:21:53.094777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'21","last_scrub_stamp":"2024-08-31T12:21:53.094707+0000","last_deep_scrub":"56'21","last_deep_scrub_stamp":"2024-08-31T12:21:53.094707+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.094707+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:32:50.336119+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":17,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"56'366","reported_seq":2531,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.589290+0000","last_change":"2024-08-31T12:21:54.589203+0000","last_active":"2024-08-31T12:21:54.589290+0000","last_peered":"2024-08-31T12:21:54.589290+0000","last_clean":"2024-08-31T12:21:54.589290+0000","last_became_active":"2024-08-31T12:13:50.742089+0000","last_became_peered":"2024-08-31T12:13:50.742089+0000","last_unstale":"2024-08-31T12:21:54.589290+0000","last_undegraded":"2024-08-31T12:21:54.589290+0000","last_fullsized":"2024-08-31T12:21:54.589290+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'366","last_scrub_stamp":"2024-08-31T12:21:54.589106+0000","last_deep_scrub":"56'366","last_deep_scrub_stamp":"2024-08-31T12:21:54.589106+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.589106+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:39:11.082146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.13132229200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":4137,"num_write":364,"num_write_kb":28847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"56'93","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.955789+0000","last_change":"2024-08-31T12:22:02.955789+0000","last_active":"2024-08-31T12:22:02.955789+0000","last_peered":"2024-08-31T12:22:02.955789+0000","last_clean":"2024-08-31T12:22:02.955789+0000","last_became_active":"2024-08-31T12:13:46.680607+0000","last_became_peered":"2024-08-31T12:13:46.680607+0000","last_unstale":"2024-08-31T12:22:02.955789+0000","last_undegraded":"2024-08-31T12:22:02.955789+0000","last_fullsized":"2024-08-31T12:22:02.955789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:02.955699+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:02.955699+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.955699+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:02:40.565748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.215945258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"56'304","reported_seq":423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.753749+0000","last_change":"2024-08-31T12:21:55.753749+0000","last_active":"2024-08-31T12:21:55.753749+0000","last_peered":"2024-08-31T12:21:55.753749+0000","last_clean":"2024-08-31T12:21:55.753749+0000","last_became_active":"2024-08-31T12:13:45.680620+0000","last_became_peered":"2024-08-31T12:13:45.680620+0000","last_unstale":"2024-08-31T12:21:55.753749+0000","last_undegraded":"2024-08-31T12:21:55.753749+0000","last_fullsized":"2024-08-31T12:21:55.753749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'304","last_scrub_stamp":"2024-08-31T12:21:55.753394+0000","last_deep_scrub":"56'304","last_deep_scrub_stamp":"2024-08-31T12:21:55.753394+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.753394+0000","objects_scrubbed":6,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:33:14.734406+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":20193,"num_write":298,"num_write_kb":8351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"43'358","reported_seq":2510,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:09.855930+0000","last_change":"2024-08-31T12:22:09.855930+0000","last_active":"2024-08-31T12:22:09.855930+0000","last_peered":"2024-08-31T12:22:09.855930+0000","last_clean":"2024-08-31T12:22:09.855930+0000","last_became_active":"2024-08-31T12:13:50.754565+0000","last_became_peered":"2024-08-31T12:13:50.754565+0000","last_unstale":"2024-08-31T12:22:09.855930+0000","last_undegraded":"2024-08-31T12:22:09.855930+0000","last_fullsized":"2024-08-31T12:22:09.855930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'358","last_scrub_stamp":"2024-08-31T12:22:09.855594+0000","last_deep_scrub":"43'358","last_deep_scrub_stamp":"2024-08-31T12:22:09.855594+0000","last_clean_scrub_stamp":"2024-08-31T12:22:09.855594+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:49.502535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22843498500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":356,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"56'90","reported_seq":2211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.568257+0000","last_change":"2024-08-31T12:21:49.568257+0000","last_active":"2024-08-31T12:21:49.568257+0000","last_peered":"2024-08-31T12:21:49.568257+0000","last_clean":"2024-08-31T12:21:49.568257+0000","last_became_active":"2024-08-31T12:13:46.704661+0000","last_became_peered":"2024-08-31T12:13:46.704661+0000","last_unstale":"2024-08-31T12:21:49.568257+0000","last_undegraded":"2024-08-31T12:21:49.568257+0000","last_fullsized":"2024-08-31T12:21:49.568257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:49.568128+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.568128+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:34:33.999379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.132072997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"56'3","reported_seq":94,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.112961+0000","last_change":"2024-08-31T12:21:51.112961+0000","last_active":"2024-08-31T12:21:51.112961+0000","last_peered":"2024-08-31T12:21:51.112961+0000","last_clean":"2024-08-31T12:21:51.112961+0000","last_became_active":"2024-08-31T12:13:45.667716+0000","last_became_peered":"2024-08-31T12:13:45.667716+0000","last_unstale":"2024-08-31T12:21:51.112961+0000","last_undegraded":"2024-08-31T12:21:51.112961+0000","last_fullsized":"2024-08-31T12:21:51.112961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3","last_scrub_stamp":"2024-08-31T12:21:51.112861+0000","last_deep_scrub":"56'3","last_deep_scrub_stamp":"2024-08-31T12:21:51.112861+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.112861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:11:26.979144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"56'320","reported_seq":2480,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:10.879816+0000","last_change":"2024-08-31T12:22:10.879816+0000","last_active":"2024-08-31T12:22:10.879816+0000","last_peered":"2024-08-31T12:22:10.879816+0000","last_clean":"2024-08-31T12:22:10.879816+0000","last_became_active":"2024-08-31T12:13:50.740656+0000","last_became_peered":"2024-08-31T12:13:50.740656+0000","last_unstale":"2024-08-31T12:22:10.879816+0000","last_undegraded":"2024-08-31T12:22:10.879816+0000","last_fullsized":"2024-08-31T12:22:10.879816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'320","last_scrub_stamp":"2024-08-31T12:22:10.879593+0000","last_deep_scrub":"56'320","last_deep_scrub_stamp":"2024-08-31T12:22:10.879593+0000","last_clean_scrub_stamp":"2024-08-31T12:22:10.879593+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:11:02.576738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22506085200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":4133,"num_write":318,"num_write_kb":20642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"56'101","reported_seq":2228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.932046+0000","last_change":"2024-08-31T12:22:03.932046+0000","last_active":"2024-08-31T12:22:03.932046+0000","last_peered":"2024-08-31T12:22:03.932046+0000","last_clean":"2024-08-31T12:22:03.932046+0000","last_became_active":"2024-08-31T12:14:28.096238+0000","last_became_peered":"2024-08-31T12:14:28.096238+0000","last_unstale":"2024-08-31T12:22:03.932046+0000","last_undegraded":"2024-08-31T12:22:03.932046+0000","last_fullsized":"2024-08-31T12:22:03.932046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'101","last_scrub_stamp":"2024-08-31T12:22:03.931958+0000","last_deep_scrub":"56'101","last_deep_scrub_stamp":"2024-08-31T12:22:03.931958+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.931958+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:05.817013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20981760799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.891661+0000","last_change":"2024-08-31T12:21:53.891661+0000","last_active":"2024-08-31T12:21:53.891661+0000","last_peered":"2024-08-31T12:21:53.891661+0000","last_clean":"2024-08-31T12:21:53.891661+0000","last_became_active":"2024-08-31T12:13:45.676914+0000","last_became_peered":"2024-08-31T12:13:45.676914+0000","last_unstale":"2024-08-31T12:21:53.891661+0000","last_undegraded":"2024-08-31T12:21:53.891661+0000","last_fullsized":"2024-08-31T12:21:53.891661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:21:53.891567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:21:53.891567+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.891567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:48:27.669347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"56'304","reported_seq":2448,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.639992+0000","last_change":"2024-08-31T12:22:06.639992+0000","last_active":"2024-08-31T12:22:06.639992+0000","last_peered":"2024-08-31T12:22:06.639992+0000","last_clean":"2024-08-31T12:22:06.639992+0000","last_became_active":"2024-08-31T12:13:50.770092+0000","last_became_peered":"2024-08-31T12:13:50.770092+0000","last_unstale":"2024-08-31T12:22:06.639992+0000","last_undegraded":"2024-08-31T12:22:06.639992+0000","last_fullsized":"2024-08-31T12:22:06.639992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'304","last_scrub_stamp":"2024-08-31T12:22:06.639668+0000","last_deep_scrub":"56'304","last_deep_scrub_stamp":"2024-08-31T12:22:06.639668+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.639668+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:16:12.935828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.142846694,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":302,"num_write_kb":32911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"56'87","reported_seq":2209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.542185+0000","last_change":"2024-08-31T12:21:57.542185+0000","last_active":"2024-08-31T12:21:57.542185+0000","last_peered":"2024-08-31T12:21:57.542185+0000","last_clean":"2024-08-31T12:21:57.542185+0000","last_became_active":"2024-08-31T12:13:46.685910+0000","last_became_peered":"2024-08-31T12:13:46.685910+0000","last_unstale":"2024-08-31T12:21:57.542185+0000","last_undegraded":"2024-08-31T12:21:57.542185+0000","last_fullsized":"2024-08-31T12:21:57.542185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'87","last_scrub_stamp":"2024-08-31T12:21:57.541995+0000","last_deep_scrub":"56'87","last_deep_scrub_stamp":"2024-08-31T12:21:57.541995+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.541995+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:04.441090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12728674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"56'132","reported_seq":238,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.922647+0000","last_change":"2024-08-31T12:21:54.922647+0000","last_active":"2024-08-31T12:21:54.922647+0000","last_peered":"2024-08-31T12:21:54.922647+0000","last_clean":"2024-08-31T12:21:54.922647+0000","last_became_active":"2024-08-31T12:13:45.685374+0000","last_became_peered":"2024-08-31T12:13:45.685374+0000","last_unstale":"2024-08-31T12:21:54.922647+0000","last_undegraded":"2024-08-31T12:21:54.922647+0000","last_fullsized":"2024-08-31T12:21:54.922647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'132","last_scrub_stamp":"2024-08-31T12:21:54.922391+0000","last_deep_scrub":"56'132","last_deep_scrub_stamp":"2024-08-31T12:21:54.922391+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.922391+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:39.128053+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":28704,"num_write":125,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"56'333","reported_seq":2489,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:13.993978+0000","last_change":"2024-08-31T12:22:13.993978+0000","last_active":"2024-08-31T12:22:13.993978+0000","last_peered":"2024-08-31T12:22:13.993978+0000","last_clean":"2024-08-31T12:22:13.993978+0000","last_became_active":"2024-08-31T12:13:50.731329+0000","last_became_peered":"2024-08-31T12:13:50.731329+0000","last_unstale":"2024-08-31T12:22:13.993978+0000","last_undegraded":"2024-08-31T12:22:13.993978+0000","last_fullsized":"2024-08-31T12:22:13.993978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'333","last_scrub_stamp":"2024-08-31T12:22:13.993882+0000","last_deep_scrub":"56'333","last_deep_scrub_stamp":"2024-08-31T12:22:13.993882+0000","last_clean_scrub_stamp":"2024-08-31T12:22:13.993882+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:38:55.484067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.214350496,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":332,"num_write_kb":16550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"56'83","reported_seq":2204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.032328+0000","last_change":"2024-08-31T12:22:04.032328+0000","last_active":"2024-08-31T12:22:04.032328+0000","last_peered":"2024-08-31T12:22:04.032328+0000","last_clean":"2024-08-31T12:22:04.032328+0000","last_became_active":"2024-08-31T12:13:46.667355+0000","last_became_peered":"2024-08-31T12:13:46.667355+0000","last_unstale":"2024-08-31T12:22:04.032328+0000","last_undegraded":"2024-08-31T12:22:04.032328+0000","last_fullsized":"2024-08-31T12:22:04.032328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:04.032240+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:04.032240+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.032240+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:11:33.130041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.071755147000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"56'177","reported_seq":292,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:52.509984+0000","last_change":"2024-08-31T12:21:52.509984+0000","last_active":"2024-08-31T12:21:52.509984+0000","last_peered":"2024-08-31T12:21:52.509984+0000","last_clean":"2024-08-31T12:21:52.509984+0000","last_became_active":"2024-08-31T12:13:45.682358+0000","last_became_peered":"2024-08-31T12:13:45.682358+0000","last_unstale":"2024-08-31T12:21:52.509984+0000","last_undegraded":"2024-08-31T12:21:52.509984+0000","last_fullsized":"2024-08-31T12:21:52.509984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'177","last_scrub_stamp":"2024-08-31T12:21:52.509906+0000","last_deep_scrub":"56'177","last_deep_scrub_stamp":"2024-08-31T12:21:52.509906+0000","last_clean_scrub_stamp":"2024-08-31T12:21:52.509906+0000","objects_scrubbed":6,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:59.120434+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":40983,"num_write":165,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'341","reported_seq":2500,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.818564+0000","last_change":"2024-08-31T12:22:05.818564+0000","last_active":"2024-08-31T12:22:05.818564+0000","last_peered":"2024-08-31T12:22:05.818564+0000","last_clean":"2024-08-31T12:22:05.818564+0000","last_became_active":"2024-08-31T12:13:50.734577+0000","last_became_peered":"2024-08-31T12:13:50.734577+0000","last_unstale":"2024-08-31T12:22:05.818564+0000","last_undegraded":"2024-08-31T12:22:05.818564+0000","last_fullsized":"2024-08-31T12:22:05.818564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'341","last_scrub_stamp":"2024-08-31T12:22:05.818359+0000","last_deep_scrub":"56'341","last_deep_scrub_stamp":"2024-08-31T12:22:05.818359+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.818359+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:48.316125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18865232600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":4133,"num_write":338,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"56'86","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.918607+0000","last_change":"2024-08-31T12:22:04.918607+0000","last_active":"2024-08-31T12:22:04.918607+0000","last_peered":"2024-08-31T12:22:04.918607+0000","last_clean":"2024-08-31T12:22:04.918607+0000","last_became_active":"2024-08-31T12:13:46.678068+0000","last_became_peered":"2024-08-31T12:13:46.678068+0000","last_unstale":"2024-08-31T12:22:04.918607+0000","last_undegraded":"2024-08-31T12:22:04.918607+0000","last_fullsized":"2024-08-31T12:22:04.918607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'86","last_scrub_stamp":"2024-08-31T12:22:04.918452+0000","last_deep_scrub":"56'86","last_deep_scrub_stamp":"2024-08-31T12:22:04.918452+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.918452+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:52.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209754103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"56'252","reported_seq":356,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.960721+0000","last_change":"2024-08-31T12:21:53.960721+0000","last_active":"2024-08-31T12:21:53.960721+0000","last_peered":"2024-08-31T12:21:53.960721+0000","last_clean":"2024-08-31T12:21:53.960721+0000","last_became_active":"2024-08-31T12:13:45.687851+0000","last_became_peered":"2024-08-31T12:13:45.687851+0000","last_unstale":"2024-08-31T12:21:53.960721+0000","last_undegraded":"2024-08-31T12:21:53.960721+0000","last_fullsized":"2024-08-31T12:21:53.960721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'252","last_scrub_stamp":"2024-08-31T12:21:53.960459+0000","last_deep_scrub":"56'252","last_deep_scrub_stamp":"2024-08-31T12:21:53.960459+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.960459+0000","objects_scrubbed":3,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:37.818459+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":12307,"num_write":250,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"56'323","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.471328+0000","last_change":"2024-08-31T12:22:01.471328+0000","last_active":"2024-08-31T12:22:01.471328+0000","last_peered":"2024-08-31T12:22:01.471328+0000","last_clean":"2024-08-31T12:22:01.471328+0000","last_became_active":"2024-08-31T12:13:50.752374+0000","last_became_peered":"2024-08-31T12:13:50.752374+0000","last_unstale":"2024-08-31T12:22:01.471328+0000","last_undegraded":"2024-08-31T12:22:01.471328+0000","last_fullsized":"2024-08-31T12:22:01.471328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'323","last_scrub_stamp":"2024-08-31T12:22:01.471202+0000","last_deep_scrub":"56'323","last_deep_scrub_stamp":"2024-08-31T12:22:01.471202+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.471202+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:01:52.385947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.20838406400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":4139,"num_write":322,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.898031+0000","last_change":"2024-08-31T12:21:53.898031+0000","last_active":"2024-08-31T12:21:53.898031+0000","last_peered":"2024-08-31T12:21:53.898031+0000","last_clean":"2024-08-31T12:21:53.898031+0000","last_became_active":"2024-08-31T12:13:46.704244+0000","last_became_peered":"2024-08-31T12:13:46.704244+0000","last_unstale":"2024-08-31T12:21:53.898031+0000","last_undegraded":"2024-08-31T12:21:53.898031+0000","last_fullsized":"2024-08-31T12:21:53.898031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:21:53.897846+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:21:53.897846+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.897846+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:30:11.857169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22521776600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'25","reported_seq":119,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:49.096554+0000","last_change":"2024-08-31T12:21:49.096554+0000","last_active":"2024-08-31T12:21:49.096554+0000","last_peered":"2024-08-31T12:21:49.096554+0000","last_clean":"2024-08-31T12:21:49.096554+0000","last_became_active":"2024-08-31T12:13:45.673384+0000","last_became_peered":"2024-08-31T12:13:45.673384+0000","last_unstale":"2024-08-31T12:21:49.096554+0000","last_undegraded":"2024-08-31T12:21:49.096554+0000","last_fullsized":"2024-08-31T12:21:49.096554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-08-31T12:21:49.096488+0000","last_clean_scrub_stamp":"2024-08-31T12:21:49.096488+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:21.965086+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":21,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"56'358","reported_seq":2511,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.921208+0000","last_change":"2024-08-31T12:21:59.921208+0000","last_active":"2024-08-31T12:21:59.921208+0000","last_peered":"2024-08-31T12:21:59.921208+0000","last_clean":"2024-08-31T12:21:59.921208+0000","last_became_active":"2024-08-31T12:13:50.751050+0000","last_became_peered":"2024-08-31T12:13:50.751050+0000","last_unstale":"2024-08-31T12:21:59.921208+0000","last_undegraded":"2024-08-31T12:21:59.921208+0000","last_fullsized":"2024-08-31T12:21:59.921208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'358","last_scrub_stamp":"2024-08-31T12:21:59.920857+0000","last_deep_scrub":"56'358","last_deep_scrub_stamp":"2024-08-31T12:21:59.920857+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.920857+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:00.606074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14712604100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":350,"num_write_kb":23923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"56'105","reported_seq":2227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.468027+0000","last_change":"2024-08-31T12:21:53.468027+0000","last_active":"2024-08-31T12:21:53.468027+0000","last_peered":"2024-08-31T12:21:53.468027+0000","last_clean":"2024-08-31T12:21:53.468027+0000","last_became_active":"2024-08-31T12:13:46.676136+0000","last_became_peered":"2024-08-31T12:13:46.676136+0000","last_unstale":"2024-08-31T12:21:53.468027+0000","last_undegraded":"2024-08-31T12:21:53.468027+0000","last_fullsized":"2024-08-31T12:21:53.468027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:53.467917+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:53.467917+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.467917+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:21.517989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.186939627,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"56'6","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:50.601108+0000","last_change":"2024-08-31T12:21:50.601108+0000","last_active":"2024-08-31T12:21:50.601108+0000","last_peered":"2024-08-31T12:21:50.601108+0000","last_clean":"2024-08-31T12:21:50.601108+0000","last_became_active":"2024-08-31T12:13:45.676391+0000","last_became_peered":"2024-08-31T12:13:45.676391+0000","last_unstale":"2024-08-31T12:21:50.601108+0000","last_undegraded":"2024-08-31T12:21:50.601108+0000","last_fullsized":"2024-08-31T12:21:50.601108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'6","last_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_deep_scrub":"56'6","last_deep_scrub_stamp":"2024-08-31T12:21:50.601036+0000","last_clean_scrub_stamp":"2024-08-31T12:21:50.601036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:36.462135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'338","reported_seq":2494,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.822528+0000","last_change":"2024-08-31T12:22:04.822528+0000","last_active":"2024-08-31T12:22:04.822528+0000","last_peered":"2024-08-31T12:22:04.822528+0000","last_clean":"2024-08-31T12:22:04.822528+0000","last_became_active":"2024-08-31T12:13:50.760851+0000","last_became_peered":"2024-08-31T12:13:50.760851+0000","last_unstale":"2024-08-31T12:22:04.822528+0000","last_undegraded":"2024-08-31T12:22:04.822528+0000","last_fullsized":"2024-08-31T12:22:04.822528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'338","last_scrub_stamp":"2024-08-31T12:22:04.822209+0000","last_deep_scrub":"56'338","last_deep_scrub_stamp":"2024-08-31T12:22:04.822209+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.822209+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:17.533730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.17081264600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":338,"num_write_kb":16549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"56'320","reported_seq":2467,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:07.830376+0000","last_change":"2024-08-31T12:22:07.830376+0000","last_active":"2024-08-31T12:22:07.830376+0000","last_peered":"2024-08-31T12:22:07.830376+0000","last_clean":"2024-08-31T12:22:07.830376+0000","last_became_active":"2024-08-31T12:13:50.737941+0000","last_became_peered":"2024-08-31T12:13:50.737941+0000","last_unstale":"2024-08-31T12:22:07.830376+0000","last_undegraded":"2024-08-31T12:22:07.830376+0000","last_fullsized":"2024-08-31T12:22:07.830376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'320","last_scrub_stamp":"2024-08-31T12:22:07.830058+0000","last_deep_scrub":"56'320","last_deep_scrub_stamp":"2024-08-31T12:22:07.830058+0000","last_clean_scrub_stamp":"2024-08-31T12:22:07.830058+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:21:05.276989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18973087499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":320,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.791345+0000","last_change":"2024-08-31T12:21:59.791345+0000","last_active":"2024-08-31T12:21:59.791345+0000","last_peered":"2024-08-31T12:21:59.791345+0000","last_clean":"2024-08-31T12:21:59.791345+0000","last_became_active":"2024-08-31T12:13:46.685662+0000","last_became_peered":"2024-08-31T12:13:46.685662+0000","last_unstale":"2024-08-31T12:21:59.791345+0000","last_undegraded":"2024-08-31T12:21:59.791345+0000","last_fullsized":"2024-08-31T12:21:59.791345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:59.791153+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:59.791153+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.791153+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:44.697365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.170652849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"56'223","reported_seq":321,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.924537+0000","last_change":"2024-08-31T12:22:00.924537+0000","last_active":"2024-08-31T12:22:00.924537+0000","last_peered":"2024-08-31T12:22:00.924537+0000","last_clean":"2024-08-31T12:22:00.924537+0000","last_became_active":"2024-08-31T12:13:45.658275+0000","last_became_peered":"2024-08-31T12:13:45.658275+0000","last_unstale":"2024-08-31T12:22:00.924537+0000","last_undegraded":"2024-08-31T12:22:00.924537+0000","last_fullsized":"2024-08-31T12:22:00.924537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'223","last_scrub_stamp":"2024-08-31T12:22:00.924455+0000","last_deep_scrub":"56'223","last_deep_scrub_stamp":"2024-08-31T12:22:00.924455+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.924455+0000","objects_scrubbed":2,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:17.844779+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":219,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'327","reported_seq":2482,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:14.992320+0000","last_change":"2024-08-31T12:22:14.992320+0000","last_active":"2024-08-31T12:22:14.992320+0000","last_peered":"2024-08-31T12:22:14.992320+0000","last_clean":"2024-08-31T12:22:14.992320+0000","last_became_active":"2024-08-31T12:13:50.716363+0000","last_became_peered":"2024-08-31T12:13:50.716363+0000","last_unstale":"2024-08-31T12:22:14.992320+0000","last_undegraded":"2024-08-31T12:22:14.992320+0000","last_fullsized":"2024-08-31T12:22:14.992320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'327","last_scrub_stamp":"2024-08-31T12:22:14.992202+0000","last_deep_scrub":"56'327","last_deep_scrub_stamp":"2024-08-31T12:22:14.992202+0000","last_clean_scrub_stamp":"2024-08-31T12:22:14.992202+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:40.858488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21271066899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":326,"num_write_kb":16543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"56'109","reported_seq":2231,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.907300+0000","last_change":"2024-08-31T12:21:56.907300+0000","last_active":"2024-08-31T12:21:56.907300+0000","last_peered":"2024-08-31T12:21:56.907300+0000","last_clean":"2024-08-31T12:21:56.907300+0000","last_became_active":"2024-08-31T12:13:46.700043+0000","last_became_peered":"2024-08-31T12:13:46.700043+0000","last_unstale":"2024-08-31T12:21:56.907300+0000","last_undegraded":"2024-08-31T12:21:56.907300+0000","last_fullsized":"2024-08-31T12:21:56.907300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:56.906981+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:56.906981+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.906981+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:07:05.610056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23161641399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"56'25","reported_seq":120,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.577447+0000","last_change":"2024-08-31T12:21:54.577447+0000","last_active":"2024-08-31T12:21:54.577447+0000","last_peered":"2024-08-31T12:21:54.577447+0000","last_clean":"2024-08-31T12:21:54.577447+0000","last_became_active":"2024-08-31T12:13:45.679411+0000","last_became_peered":"2024-08-31T12:13:45.679411+0000","last_unstale":"2024-08-31T12:21:54.577447+0000","last_undegraded":"2024-08-31T12:21:54.577447+0000","last_fullsized":"2024-08-31T12:21:54.577447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'25","last_scrub_stamp":"2024-08-31T12:21:54.576891+0000","last_deep_scrub":"56'25","last_deep_scrub_stamp":"2024-08-31T12:21:54.576891+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.576891+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:04.497495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":23,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"56'105","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.963841+0000","last_change":"2024-08-31T12:21:57.963841+0000","last_active":"2024-08-31T12:21:57.963841+0000","last_peered":"2024-08-31T12:21:57.963841+0000","last_clean":"2024-08-31T12:21:57.963841+0000","last_became_active":"2024-08-31T12:13:45.674212+0000","last_became_peered":"2024-08-31T12:13:45.674212+0000","last_unstale":"2024-08-31T12:21:57.963841+0000","last_undegraded":"2024-08-31T12:21:57.963841+0000","last_fullsized":"2024-08-31T12:21:57.963841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:57.963752+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:57.963752+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.963752+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:56:25.214409+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":40960,"num_write":101,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.816713+0000","last_change":"2024-08-31T12:22:01.816713+0000","last_active":"2024-08-31T12:22:01.816713+0000","last_peered":"2024-08-31T12:22:01.816713+0000","last_clean":"2024-08-31T12:22:01.816713+0000","last_became_active":"2024-08-31T12:13:46.688165+0000","last_became_peered":"2024-08-31T12:13:46.688165+0000","last_unstale":"2024-08-31T12:22:01.816713+0000","last_undegraded":"2024-08-31T12:22:01.816713+0000","last_fullsized":"2024-08-31T12:22:01.816713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:01.816518+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:01.816518+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.816518+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:20.204165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928562500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"56'305","reported_seq":2447,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.851209+0000","last_change":"2024-08-31T12:22:06.851209+0000","last_active":"2024-08-31T12:22:06.851209+0000","last_peered":"2024-08-31T12:22:06.851209+0000","last_clean":"2024-08-31T12:22:06.851209+0000","last_became_active":"2024-08-31T12:13:50.762796+0000","last_became_peered":"2024-08-31T12:13:50.762796+0000","last_unstale":"2024-08-31T12:22:06.851209+0000","last_undegraded":"2024-08-31T12:22:06.851209+0000","last_fullsized":"2024-08-31T12:22:06.851209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'305","last_scrub_stamp":"2024-08-31T12:22:06.850991+0000","last_deep_scrub":"56'305","last_deep_scrub_stamp":"2024-08-31T12:22:06.850991+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.850991+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:14:14.155816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.19554324300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28,"num_write":304,"num_write_kb":12442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'60","reported_seq":157,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.944464+0000","last_change":"2024-08-31T12:21:58.944464+0000","last_active":"2024-08-31T12:21:58.944464+0000","last_peered":"2024-08-31T12:21:58.944464+0000","last_clean":"2024-08-31T12:21:58.944464+0000","last_became_active":"2024-08-31T12:13:45.692017+0000","last_became_peered":"2024-08-31T12:13:45.692017+0000","last_unstale":"2024-08-31T12:21:58.944464+0000","last_undegraded":"2024-08-31T12:21:58.944464+0000","last_fullsized":"2024-08-31T12:21:58.944464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'60","last_scrub_stamp":"2024-08-31T12:21:58.944263+0000","last_deep_scrub":"56'60","last_deep_scrub_stamp":"2024-08-31T12:21:58.944263+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.944263+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:37.968801+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":60,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6858,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"56'85","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:51.553850+0000","last_change":"2024-08-31T12:21:51.553850+0000","last_active":"2024-08-31T12:21:51.553850+0000","last_peered":"2024-08-31T12:21:51.553850+0000","last_clean":"2024-08-31T12:21:51.553850+0000","last_became_active":"2024-08-31T12:13:46.704599+0000","last_became_peered":"2024-08-31T12:13:46.704599+0000","last_unstale":"2024-08-31T12:21:51.553850+0000","last_undegraded":"2024-08-31T12:21:51.553850+0000","last_fullsized":"2024-08-31T12:21:51.553850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:21:51.553754+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:21:51.553754+0000","last_clean_scrub_stamp":"2024-08-31T12:21:51.553754+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:53.962596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13698886499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'322","reported_seq":2484,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.900477+0000","last_change":"2024-08-31T12:22:01.900477+0000","last_active":"2024-08-31T12:22:01.900477+0000","last_peered":"2024-08-31T12:22:01.900477+0000","last_clean":"2024-08-31T12:22:01.900477+0000","last_became_active":"2024-08-31T12:13:50.759250+0000","last_became_peered":"2024-08-31T12:13:50.759250+0000","last_unstale":"2024-08-31T12:22:01.900477+0000","last_undegraded":"2024-08-31T12:22:01.900477+0000","last_fullsized":"2024-08-31T12:22:01.900477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'322","last_scrub_stamp":"2024-08-31T12:22:01.900269+0000","last_deep_scrub":"56'322","last_deep_scrub_stamp":"2024-08-31T12:22:01.900269+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.900269+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:37:12.865745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14930658499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":8234,"num_write":320,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"56'109","reported_seq":2232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.465348+0000","last_change":"2024-08-31T12:21:54.465276+0000","last_active":"2024-08-31T12:21:54.465348+0000","last_peered":"2024-08-31T12:21:54.465348+0000","last_clean":"2024-08-31T12:21:54.465348+0000","last_became_active":"2024-08-31T12:13:46.664917+0000","last_became_peered":"2024-08-31T12:13:46.664917+0000","last_unstale":"2024-08-31T12:21:54.465348+0000","last_undegraded":"2024-08-31T12:21:54.465348+0000","last_fullsized":"2024-08-31T12:21:54.465348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:54.465190+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:54.465190+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.465190+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:53.857159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19594988599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"56'111","reported_seq":2233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.918399+0000","last_change":"2024-08-31T12:21:58.918117+0000","last_active":"2024-08-31T12:21:58.918399+0000","last_peered":"2024-08-31T12:21:58.918399+0000","last_clean":"2024-08-31T12:21:58.918399+0000","last_became_active":"2024-08-31T12:13:46.684566+0000","last_became_peered":"2024-08-31T12:13:46.684566+0000","last_unstale":"2024-08-31T12:21:58.918399+0000","last_undegraded":"2024-08-31T12:21:58.918399+0000","last_fullsized":"2024-08-31T12:21:58.918399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'111","last_scrub_stamp":"2024-08-31T12:21:58.917883+0000","last_deep_scrub":"56'111","last_deep_scrub_stamp":"2024-08-31T12:21:58.917883+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.917883+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:23.511452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14754552000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"56'101","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.893639+0000","last_change":"2024-08-31T12:22:06.893639+0000","last_active":"2024-08-31T12:22:06.893639+0000","last_peered":"2024-08-31T12:22:06.893639+0000","last_clean":"2024-08-31T12:22:06.893639+0000","last_became_active":"2024-08-31T12:13:46.711642+0000","last_became_peered":"2024-08-31T12:13:46.711642+0000","last_unstale":"2024-08-31T12:22:06.893639+0000","last_undegraded":"2024-08-31T12:22:06.893639+0000","last_fullsized":"2024-08-31T12:22:06.893639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'101","last_scrub_stamp":"2024-08-31T12:22:06.893546+0000","last_deep_scrub":"56'101","last_deep_scrub_stamp":"2024-08-31T12:22:06.893546+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.893546+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:00.419090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21748506300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"56'99","reported_seq":2222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.891070+0000","last_change":"2024-08-31T12:21:57.890773+0000","last_active":"2024-08-31T12:21:57.891070+0000","last_peered":"2024-08-31T12:21:57.891070+0000","last_clean":"2024-08-31T12:21:57.891070+0000","last_became_active":"2024-08-31T12:13:46.708023+0000","last_became_peered":"2024-08-31T12:13:46.708023+0000","last_unstale":"2024-08-31T12:21:57.891070+0000","last_undegraded":"2024-08-31T12:21:57.891070+0000","last_fullsized":"2024-08-31T12:21:57.891070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'99","last_scrub_stamp":"2024-08-31T12:21:57.890466+0000","last_deep_scrub":"56'99","last_deep_scrub_stamp":"2024-08-31T12:21:57.890466+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.890466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:19.780314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.23056249600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"56'80","reported_seq":2203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.558782+0000","last_change":"2024-08-31T12:21:58.558608+0000","last_active":"2024-08-31T12:21:58.558782+0000","last_peered":"2024-08-31T12:21:58.558782+0000","last_clean":"2024-08-31T12:21:58.558782+0000","last_became_active":"2024-08-31T12:13:46.680366+0000","last_became_peered":"2024-08-31T12:13:46.680366+0000","last_unstale":"2024-08-31T12:21:58.558782+0000","last_undegraded":"2024-08-31T12:21:58.558782+0000","last_fullsized":"2024-08-31T12:21:58.558782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'80","last_scrub_stamp":"2024-08-31T12:21:58.558410+0000","last_deep_scrub":"56'80","last_deep_scrub_stamp":"2024-08-31T12:21:58.558410+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.558410+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:56:17.846661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.111237059,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"56'73","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.548089+0000","last_change":"2024-08-31T12:21:59.547927+0000","last_active":"2024-08-31T12:21:59.548089+0000","last_peered":"2024-08-31T12:21:59.548089+0000","last_clean":"2024-08-31T12:21:59.548089+0000","last_became_active":"2024-08-31T12:13:46.698561+0000","last_became_peered":"2024-08-31T12:13:46.698561+0000","last_unstale":"2024-08-31T12:21:59.548089+0000","last_undegraded":"2024-08-31T12:21:59.548089+0000","last_fullsized":"2024-08-31T12:21:59.548089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'73","last_scrub_stamp":"2024-08-31T12:21:59.547734+0000","last_deep_scrub":"56'73","last_deep_scrub_stamp":"2024-08-31T12:21:59.547734+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.547734+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:20:08.837141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.121213934,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"56'109","reported_seq":2232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.497048+0000","last_change":"2024-08-31T12:21:55.496976+0000","last_active":"2024-08-31T12:21:55.497048+0000","last_peered":"2024-08-31T12:21:55.497048+0000","last_clean":"2024-08-31T12:21:55.497048+0000","last_became_active":"2024-08-31T12:13:46.675768+0000","last_became_peered":"2024-08-31T12:13:46.675768+0000","last_unstale":"2024-08-31T12:21:55.497048+0000","last_undegraded":"2024-08-31T12:21:55.497048+0000","last_fullsized":"2024-08-31T12:21:55.497048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'109","last_scrub_stamp":"2024-08-31T12:21:55.496895+0000","last_deep_scrub":"56'109","last_deep_scrub_stamp":"2024-08-31T12:21:55.496895+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.496895+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:40:45.970404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18600264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"56'83","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.901152+0000","last_change":"2024-08-31T12:22:03.900868+0000","last_active":"2024-08-31T12:22:03.901152+0000","last_peered":"2024-08-31T12:22:03.901152+0000","last_clean":"2024-08-31T12:22:03.901152+0000","last_became_active":"2024-08-31T12:13:46.705631+0000","last_became_peered":"2024-08-31T12:13:46.705631+0000","last_unstale":"2024-08-31T12:22:03.901152+0000","last_undegraded":"2024-08-31T12:22:03.901152+0000","last_fullsized":"2024-08-31T12:22:03.901152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'83","last_scrub_stamp":"2024-08-31T12:22:03.900619+0000","last_deep_scrub":"56'83","last_deep_scrub_stamp":"2024-08-31T12:22:03.900619+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.900619+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:56:49.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22778747599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"56'93","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.869467+0000","last_change":"2024-08-31T12:22:05.869385+0000","last_active":"2024-08-31T12:22:05.869467+0000","last_peered":"2024-08-31T12:22:05.869467+0000","last_clean":"2024-08-31T12:22:05.869467+0000","last_became_active":"2024-08-31T12:13:46.711818+0000","last_became_peered":"2024-08-31T12:13:46.711818+0000","last_unstale":"2024-08-31T12:22:05.869467+0000","last_undegraded":"2024-08-31T12:22:05.869467+0000","last_fullsized":"2024-08-31T12:22:05.869467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:05.869298+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:05.869298+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.869298+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:28.179568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21242058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"56'93","reported_seq":2215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:04.906601+0000","last_change":"2024-08-31T12:22:04.906601+0000","last_active":"2024-08-31T12:22:04.906601+0000","last_peered":"2024-08-31T12:22:04.906601+0000","last_clean":"2024-08-31T12:22:04.906601+0000","last_became_active":"2024-08-31T12:13:46.701086+0000","last_became_peered":"2024-08-31T12:13:46.701086+0000","last_unstale":"2024-08-31T12:22:04.906601+0000","last_undegraded":"2024-08-31T12:22:04.906601+0000","last_fullsized":"2024-08-31T12:22:04.906601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'93","last_scrub_stamp":"2024-08-31T12:22:04.906404+0000","last_deep_scrub":"56'93","last_deep_scrub_stamp":"2024-08-31T12:22:04.906404+0000","last_clean_scrub_stamp":"2024-08-31T12:22:04.906404+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:52.904294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22981017300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"56'96","reported_seq":2217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:53.610570+0000","last_change":"2024-08-31T12:21:53.610570+0000","last_active":"2024-08-31T12:21:53.610570+0000","last_peered":"2024-08-31T12:21:53.610570+0000","last_clean":"2024-08-31T12:21:53.610570+0000","last_became_active":"2024-08-31T12:13:46.661042+0000","last_became_peered":"2024-08-31T12:13:46.661042+0000","last_unstale":"2024-08-31T12:21:53.610570+0000","last_undegraded":"2024-08-31T12:21:53.610570+0000","last_fullsized":"2024-08-31T12:21:53.610570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'96","last_scrub_stamp":"2024-08-31T12:21:53.610492+0000","last_deep_scrub":"56'96","last_deep_scrub_stamp":"2024-08-31T12:21:53.610492+0000","last_clean_scrub_stamp":"2024-08-31T12:21:53.610492+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:41:11.784185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14068520100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"56'90","reported_seq":2212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.834246+0000","last_change":"2024-08-31T12:22:02.834246+0000","last_active":"2024-08-31T12:22:02.834246+0000","last_peered":"2024-08-31T12:22:02.834246+0000","last_clean":"2024-08-31T12:22:02.834246+0000","last_became_active":"2024-08-31T12:13:46.696861+0000","last_became_peered":"2024-08-31T12:13:46.696861+0000","last_unstale":"2024-08-31T12:22:02.834246+0000","last_undegraded":"2024-08-31T12:22:02.834246+0000","last_fullsized":"2024-08-31T12:22:02.834246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:02.834046+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:02.834046+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.834046+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:06.250348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.18768321199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"56'97","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.076314+0000","last_change":"2024-08-31T12:22:01.076314+0000","last_active":"2024-08-31T12:22:01.076314+0000","last_peered":"2024-08-31T12:22:01.076314+0000","last_clean":"2024-08-31T12:22:01.076314+0000","last_became_active":"2024-08-31T12:13:46.666901+0000","last_became_peered":"2024-08-31T12:13:46.666901+0000","last_unstale":"2024-08-31T12:22:01.076314+0000","last_undegraded":"2024-08-31T12:22:01.076314+0000","last_fullsized":"2024-08-31T12:22:01.076314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:22:01.076211+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:22:01.076211+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.076211+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:17.054637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.072075536999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"56'85","reported_seq":2206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:08.940277+0000","last_change":"2024-08-31T12:22:08.940277+0000","last_active":"2024-08-31T12:22:08.940277+0000","last_peered":"2024-08-31T12:22:08.940277+0000","last_clean":"2024-08-31T12:22:08.940277+0000","last_became_active":"2024-08-31T12:13:46.688010+0000","last_became_peered":"2024-08-31T12:13:46.688010+0000","last_unstale":"2024-08-31T12:22:08.940277+0000","last_undegraded":"2024-08-31T12:22:08.940277+0000","last_fullsized":"2024-08-31T12:22:08.940277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:22:08.940190+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:22:08.940190+0000","last_clean_scrub_stamp":"2024-08-31T12:22:08.940190+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:26.282149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21491785099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"56'89","reported_seq":2210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.906409+0000","last_change":"2024-08-31T12:21:55.906409+0000","last_active":"2024-08-31T12:21:55.906409+0000","last_peered":"2024-08-31T12:21:55.906409+0000","last_clean":"2024-08-31T12:21:55.906409+0000","last_became_active":"2024-08-31T12:13:46.692161+0000","last_became_peered":"2024-08-31T12:13:46.692161+0000","last_unstale":"2024-08-31T12:21:55.906409+0000","last_undegraded":"2024-08-31T12:21:55.906409+0000","last_fullsized":"2024-08-31T12:21:55.906409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'89","last_scrub_stamp":"2024-08-31T12:21:55.906225+0000","last_deep_scrub":"56'89","last_deep_scrub_stamp":"2024-08-31T12:21:55.906225+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.906225+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:33:43.196096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.14763879799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"56'95","reported_seq":2216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:10.980024+0000","last_change":"2024-08-31T12:22:10.980024+0000","last_active":"2024-08-31T12:22:10.980024+0000","last_peered":"2024-08-31T12:22:10.980024+0000","last_clean":"2024-08-31T12:22:10.980024+0000","last_became_active":"2024-08-31T12:13:46.687242+0000","last_became_peered":"2024-08-31T12:13:46.687242+0000","last_unstale":"2024-08-31T12:22:10.980024+0000","last_undegraded":"2024-08-31T12:22:10.980024+0000","last_fullsized":"2024-08-31T12:22:10.980024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'95","last_scrub_stamp":"2024-08-31T12:22:10.979932+0000","last_deep_scrub":"56'95","last_deep_scrub_stamp":"2024-08-31T12:22:10.979932+0000","last_clean_scrub_stamp":"2024-08-31T12:22:10.979932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:47.498920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.211619101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"56'97","reported_seq":2218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:11.961607+0000","last_change":"2024-08-31T12:22:11.961607+0000","last_active":"2024-08-31T12:22:11.961607+0000","last_peered":"2024-08-31T12:22:11.961607+0000","last_clean":"2024-08-31T12:22:11.961607+0000","last_became_active":"2024-08-31T12:13:46.672872+0000","last_became_peered":"2024-08-31T12:13:46.672872+0000","last_unstale":"2024-08-31T12:22:11.961607+0000","last_undegraded":"2024-08-31T12:22:11.961607+0000","last_fullsized":"2024-08-31T12:22:11.961607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'97","last_scrub_stamp":"2024-08-31T12:22:11.961517+0000","last_deep_scrub":"56'97","last_deep_scrub_stamp":"2024-08-31T12:22:11.961517+0000","last_clean_scrub_stamp":"2024-08-31T12:22:11.961517+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:25:02.984549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.212113464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"56'85","reported_seq":2207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.867243+0000","last_change":"2024-08-31T12:22:05.867243+0000","last_active":"2024-08-31T12:22:05.867243+0000","last_peered":"2024-08-31T12:22:05.867243+0000","last_clean":"2024-08-31T12:22:05.867243+0000","last_became_active":"2024-08-31T12:13:46.701670+0000","last_became_peered":"2024-08-31T12:13:46.701670+0000","last_unstale":"2024-08-31T12:22:05.867243+0000","last_undegraded":"2024-08-31T12:22:05.867243+0000","last_fullsized":"2024-08-31T12:22:05.867243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'85","last_scrub_stamp":"2024-08-31T12:22:05.866905+0000","last_deep_scrub":"56'85","last_deep_scrub_stamp":"2024-08-31T12:22:05.866905+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.866905+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:26:14.522083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22935554799999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:01.609309+0000","last_change":"2024-08-31T12:22:01.609309+0000","last_active":"2024-08-31T12:22:01.609309+0000","last_peered":"2024-08-31T12:22:01.609309+0000","last_clean":"2024-08-31T12:22:01.609309+0000","last_became_active":"2024-08-31T12:13:46.676807+0000","last_became_peered":"2024-08-31T12:13:46.676807+0000","last_unstale":"2024-08-31T12:22:01.609309+0000","last_undegraded":"2024-08-31T12:22:01.609309+0000","last_fullsized":"2024-08-31T12:22:01.609309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:22:01.609033+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:22:01.609033+0000","last_clean_scrub_stamp":"2024-08-31T12:22:01.609033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:59.546816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.127219569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"56'81","reported_seq":2203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.559249+0000","last_change":"2024-08-31T12:22:00.559249+0000","last_active":"2024-08-31T12:22:00.559249+0000","last_peered":"2024-08-31T12:22:00.559249+0000","last_clean":"2024-08-31T12:22:00.559249+0000","last_became_active":"2024-08-31T12:13:46.679484+0000","last_became_peered":"2024-08-31T12:13:46.679484+0000","last_unstale":"2024-08-31T12:22:00.559249+0000","last_undegraded":"2024-08-31T12:22:00.559249+0000","last_fullsized":"2024-08-31T12:22:00.559249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'81","last_scrub_stamp":"2024-08-31T12:22:00.559056+0000","last_deep_scrub":"56'81","last_deep_scrub_stamp":"2024-08-31T12:22:00.559056+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.559056+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:17:07.875378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.12315124199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"56'76","reported_seq":2197,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:03.061185+0000","last_change":"2024-08-31T12:22:03.061185+0000","last_active":"2024-08-31T12:22:03.061185+0000","last_peered":"2024-08-31T12:22:03.061185+0000","last_clean":"2024-08-31T12:22:03.061185+0000","last_became_active":"2024-08-31T12:13:46.666922+0000","last_became_peered":"2024-08-31T12:13:46.666922+0000","last_unstale":"2024-08-31T12:22:03.061185+0000","last_undegraded":"2024-08-31T12:22:03.061185+0000","last_fullsized":"2024-08-31T12:22:03.061185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76","last_scrub_stamp":"2024-08-31T12:22:03.061096+0000","last_deep_scrub":"56'76","last_deep_scrub_stamp":"2024-08-31T12:22:03.061096+0000","last_clean_scrub_stamp":"2024-08-31T12:22:03.061096+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:18:27.184378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023103000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"56'92","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:05.982597+0000","last_change":"2024-08-31T12:22:05.982597+0000","last_active":"2024-08-31T12:22:05.982597+0000","last_peered":"2024-08-31T12:22:05.982597+0000","last_clean":"2024-08-31T12:22:05.982597+0000","last_became_active":"2024-08-31T12:13:46.674552+0000","last_became_peered":"2024-08-31T12:13:46.674552+0000","last_unstale":"2024-08-31T12:22:05.982597+0000","last_undegraded":"2024-08-31T12:22:05.982597+0000","last_fullsized":"2024-08-31T12:22:05.982597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:22:05.982501+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:22:05.982501+0000","last_clean_scrub_stamp":"2024-08-31T12:22:05.982501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:27:45.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072068862999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"56'98","reported_seq":2219,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:54.042399+0000","last_change":"2024-08-31T12:21:54.042399+0000","last_active":"2024-08-31T12:21:54.042399+0000","last_peered":"2024-08-31T12:21:54.042399+0000","last_clean":"2024-08-31T12:21:54.042399+0000","last_became_active":"2024-08-31T12:13:46.674034+0000","last_became_peered":"2024-08-31T12:13:46.674034+0000","last_unstale":"2024-08-31T12:21:54.042399+0000","last_undegraded":"2024-08-31T12:21:54.042399+0000","last_fullsized":"2024-08-31T12:21:54.042399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'98","last_scrub_stamp":"2024-08-31T12:21:54.042306+0000","last_deep_scrub":"56'98","last_deep_scrub_stamp":"2024-08-31T12:21:54.042306+0000","last_clean_scrub_stamp":"2024-08-31T12:21:54.042306+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:51.984061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072324777000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"56'84","reported_seq":2205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:55.565583+0000","last_change":"2024-08-31T12:21:55.565583+0000","last_active":"2024-08-31T12:21:55.565583+0000","last_peered":"2024-08-31T12:21:55.565583+0000","last_clean":"2024-08-31T12:21:55.565583+0000","last_became_active":"2024-08-31T12:13:46.676230+0000","last_became_peered":"2024-08-31T12:13:46.676230+0000","last_unstale":"2024-08-31T12:21:55.565583+0000","last_undegraded":"2024-08-31T12:21:55.565583+0000","last_fullsized":"2024-08-31T12:21:55.565583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'84","last_scrub_stamp":"2024-08-31T12:21:55.565502+0000","last_deep_scrub":"56'84","last_deep_scrub_stamp":"2024-08-31T12:21:55.565502+0000","last_clean_scrub_stamp":"2024-08-31T12:21:55.565502+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:43:40.464671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.107768534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"56'74","reported_seq":2196,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:59.934164+0000","last_change":"2024-08-31T12:21:59.934164+0000","last_active":"2024-08-31T12:21:59.934164+0000","last_peered":"2024-08-31T12:21:59.934164+0000","last_clean":"2024-08-31T12:21:59.934164+0000","last_became_active":"2024-08-31T12:13:46.701827+0000","last_became_peered":"2024-08-31T12:13:46.701827+0000","last_unstale":"2024-08-31T12:21:59.934164+0000","last_undegraded":"2024-08-31T12:21:59.934164+0000","last_fullsized":"2024-08-31T12:21:59.934164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74","last_scrub_stamp":"2024-08-31T12:21:59.933979+0000","last_deep_scrub":"56'74","last_deep_scrub_stamp":"2024-08-31T12:21:59.933979+0000","last_clean_scrub_stamp":"2024-08-31T12:21:59.933979+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:36:24.972114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.21283242599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"56'105","reported_seq":2226,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.082373+0000","last_change":"2024-08-31T12:21:56.082373+0000","last_active":"2024-08-31T12:21:56.082373+0000","last_peered":"2024-08-31T12:21:56.082373+0000","last_clean":"2024-08-31T12:21:56.082373+0000","last_became_active":"2024-08-31T12:13:46.691334+0000","last_became_peered":"2024-08-31T12:13:46.691334+0000","last_unstale":"2024-08-31T12:21:56.082373+0000","last_undegraded":"2024-08-31T12:21:56.082373+0000","last_fullsized":"2024-08-31T12:21:56.082373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'105","last_scrub_stamp":"2024-08-31T12:21:56.082275+0000","last_deep_scrub":"56'105","last_deep_scrub_stamp":"2024-08-31T12:21:56.082275+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.082275+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:28.430629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071315288000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"56'92","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:56.478084+0000","last_change":"2024-08-31T12:21:56.478084+0000","last_active":"2024-08-31T12:21:56.478084+0000","last_peered":"2024-08-31T12:21:56.478084+0000","last_clean":"2024-08-31T12:21:56.478084+0000","last_became_active":"2024-08-31T12:13:46.672718+0000","last_became_peered":"2024-08-31T12:13:46.672718+0000","last_unstale":"2024-08-31T12:21:56.478084+0000","last_undegraded":"2024-08-31T12:21:56.478084+0000","last_fullsized":"2024-08-31T12:21:56.478084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'92","last_scrub_stamp":"2024-08-31T12:21:56.477979+0000","last_deep_scrub":"56'92","last_deep_scrub_stamp":"2024-08-31T12:21:56.477979+0000","last_clean_scrub_stamp":"2024-08-31T12:21:56.477979+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:47:51.276480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.214820701,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"56'102","reported_seq":2223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:58.080471+0000","last_change":"2024-08-31T12:21:58.080471+0000","last_active":"2024-08-31T12:21:58.080471+0000","last_peered":"2024-08-31T12:21:58.080471+0000","last_clean":"2024-08-31T12:21:58.080471+0000","last_became_active":"2024-08-31T12:13:46.707320+0000","last_became_peered":"2024-08-31T12:13:46.707320+0000","last_unstale":"2024-08-31T12:21:58.080471+0000","last_undegraded":"2024-08-31T12:21:58.080471+0000","last_fullsized":"2024-08-31T12:21:58.080471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'102","last_scrub_stamp":"2024-08-31T12:21:58.080375+0000","last_deep_scrub":"56'102","last_deep_scrub_stamp":"2024-08-31T12:21:58.080375+0000","last_clean_scrub_stamp":"2024-08-31T12:21:58.080375+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:01:50.008145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.071548476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"56'76","reported_seq":2199,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:21:57.475583+0000","last_change":"2024-08-31T12:21:57.475583+0000","last_active":"2024-08-31T12:21:57.475583+0000","last_peered":"2024-08-31T12:21:57.475583+0000","last_clean":"2024-08-31T12:21:57.475583+0000","last_became_active":"2024-08-31T12:13:46.700179+0000","last_became_peered":"2024-08-31T12:13:46.700179+0000","last_unstale":"2024-08-31T12:21:57.475583+0000","last_undegraded":"2024-08-31T12:21:57.475583+0000","last_fullsized":"2024-08-31T12:21:57.475583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76","last_scrub_stamp":"2024-08-31T12:21:57.475493+0000","last_deep_scrub":"56'76","last_deep_scrub_stamp":"2024-08-31T12:21:57.475493+0000","last_clean_scrub_stamp":"2024-08-31T12:21:57.475493+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:19:52.256957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.207293281,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"56'90","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:02.900401+0000","last_change":"2024-08-31T12:22:02.900180+0000","last_active":"2024-08-31T12:22:02.900401+0000","last_peered":"2024-08-31T12:22:02.900401+0000","last_clean":"2024-08-31T12:22:02.900401+0000","last_became_active":"2024-08-31T12:13:46.702066+0000","last_became_peered":"2024-08-31T12:13:46.702066+0000","last_unstale":"2024-08-31T12:22:02.900401+0000","last_undegraded":"2024-08-31T12:22:02.900401+0000","last_fullsized":"2024-08-31T12:22:02.900401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'90","last_scrub_stamp":"2024-08-31T12:22:02.899951+0000","last_deep_scrub":"56'90","last_deep_scrub_stamp":"2024-08-31T12:22:02.899951+0000","last_clean_scrub_stamp":"2024-08-31T12:22:02.899951+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:25:34.271798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22542479200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"56'75","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:06.829744+0000","last_change":"2024-08-31T12:22:06.829744+0000","last_active":"2024-08-31T12:22:06.829744+0000","last_peered":"2024-08-31T12:22:06.829744+0000","last_clean":"2024-08-31T12:22:06.829744+0000","last_became_active":"2024-08-31T12:13:46.703381+0000","last_became_peered":"2024-08-31T12:13:46.703381+0000","last_unstale":"2024-08-31T12:22:06.829744+0000","last_undegraded":"2024-08-31T12:22:06.829744+0000","last_fullsized":"2024-08-31T12:22:06.829744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'75","last_scrub_stamp":"2024-08-31T12:22:06.829419+0000","last_deep_scrub":"56'75","last_deep_scrub_stamp":"2024-08-31T12:22:06.829419+0000","last_clean_scrub_stamp":"2024-08-31T12:22:06.829419+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:17:17.669839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.22804349900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"56'86","reported_seq":2208,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-08-31T12:22:00.059008+0000","last_change":"2024-08-31T12:22:00.058930+0000","last_active":"2024-08-31T12:22:00.059008+0000","last_peered":"2024-08-31T12:22:00.059008+0000","last_clean":"2024-08-31T12:22:00.059008+0000","last_became_active":"2024-08-31T12:13:46.682676+0000","last_became_peered":"2024-08-31T12:13:46.682676+0000","last_unstale":"2024-08-31T12:22:00.059008+0000","last_undegraded":"2024-08-31T12:22:00.059008+0000","last_fullsized":"2024-08-31T12:22:00.059008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'86","last_scrub_stamp":"2024-08-31T12:22:00.058851+0000","last_deep_scrub":"56'86","last_deep_scrub_stamp":"2024-08-31T12:22:00.058851+0000","last_clean_scrub_stamp":"2024-08-31T12:22:00.058851+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:00:49.251754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071957829000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1223,"num_read_kb":65823,"num_write":10786,"num_write_kb":548212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10841,"ondisk_log_size":10841,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5791,"ondisk_log_size":5791,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":144722655,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":487,"num_read_kb":466052,"num_write":4557,"num_write_kb":144703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11858,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":289505280,"data_stored":289445310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4455,"ondisk_log_size":4455,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509550,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137480,"kb_used_data":25784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94234360,"statfs":{"total":96636764160,"available":96495984640,"internally_reserved":0,"allocated":26402816,"data_stored":26087849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":114358730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106440,"kb_used_data":21112,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94265400,"statfs":{"total":96636764160,"available":96527769600,"internally_reserved":0,"allocated":21618688,"data_stored":21314193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119884,"kb_used_data":34556,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251956,"statfs":{"total":96636764160,"available":96514002944,"internally_reserved":0,"allocated":35385344,"data_stored":35066793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509550,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139212,"kb_used_data":53884,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232628,"statfs":{"total":96636764160,"available":96494211072,"internally_reserved":0,"allocated":55177216,"data_stored":54869207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509551,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96656,"kb_used_data":25216,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94275184,"statfs":{"total":96636764160,"available":96537788416,"internally_reserved":0,"allocated":25821184,"data_stored":25509169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115152,"kb_used_data":33984,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94256688,"statfs":{"total":96636764160,"available":96518848512,"internally_reserved":0,"allocated":34799616,"data_stored":34487543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509552,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167084,"kb_used_data":55388,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94204756,"statfs":{"total":96636764160,"available":96465670144,"internally_reserved":0,"allocated":56717312,"data_stored":56404302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128500,"kb_used_data":39012,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94243340,"statfs":{"total":96636764160,"available":96505180160,"internally_reserved":0,"allocated":39948288,"data_stored":39628374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56070144,"data_stored":56061629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54530048,"data_stored":54526534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39301120,"data_stored":39285701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34144256,"data_stored":34133752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25755648,"data_stored":25745176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:22:33.667 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-31T12:22:33.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- 172.21.15.164:0/803997046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 msgr2=0x7fa9040747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 --2- 172.21.15.164:0/803997046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa9040747b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009900 tx=0x7fa8fc01c820 comp rx=0 tx=0).stop 2024-08-31T12:22:33.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- 172.21.15.164:0/803997046 shutdown_connections 2024-08-31T12:22:33.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 --2- 172.21.15.164:0/803997046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa9040747b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 --2- 172.21.15.164:0/803997046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 0x7fa9040b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- 172.21.15.164:0/803997046 >> 172.21.15.164:0/803997046 conn(0x7fa9040c99b0 msgr2=0x7fa9040c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:33.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- 172.21.15.164:0/803997046 shutdown_connections 2024-08-31T12:22:33.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- 172.21.15.164:0/803997046 wait complete. 2024-08-31T12:22:33.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 Processor -- start 2024-08-31T12:22:33.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.862+0000 7fa90a000640 1 -- start start 2024-08-31T12:22:33.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 0x7fa904149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 0x7fa9041f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa904158750 con 0x7fa9040c90e0 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa9041585d0 con 0x7fa9040c1ed0 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa904165770 con 0x7fa9040b2860 2024-08-31T12:22:33.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38972/0 (socket says 172.21.15.164:38972) 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 -- 172.21.15.164:0/3120407604 learned_addr learned my addr 172.21.15.164:0/3120407604 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903400640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 0x7fa904149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa8faa00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 0x7fa9041f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 -- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 msgr2=0x7fa904149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 0x7fa904149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 -- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 msgr2=0x7fa9041f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:33.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 0x7fa9041f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:33.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 -- 172.21.15.164:0/3120407604 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9041f88e0 con 0x7fa9040c90e0 2024-08-31T12:22:33.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa8faa00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 0x7fa9041f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:22:33.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa903e00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc01aed0 tx=0x7fa8fc0a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:33.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0bc070 con 0x7fa9040c90e0 2024-08-31T12:22:33.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8fc004430 con 0x7fa9040c90e0 2024-08-31T12:22:33.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9041f92d0 con 0x7fa9040c90e0 2024-08-31T12:22:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0b2040 con 0x7fa9040c90e0 2024-08-31T12:22:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9040c6970 con 0x7fa9040c90e0 2024-08-31T12:22:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.866+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9040c6400 con 0x7fa9040c90e0 2024-08-31T12:22:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.870+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa8fc0bf070 con 0x7fa9040c90e0 2024-08-31T12:22:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.870+0000 7fa8fbe00640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 0x7fa8e0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.870+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fa8fc12c970 con 0x7fa9040c90e0 2024-08-31T12:22:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.870+0000 7fa903400640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 0x7fa8e0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.870+0000 7fa903400640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 0x7fa8e0074600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009f30 tx=0x7fa8f40096a0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:33.874+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa8fc0164d0 con 0x7fa9040c90e0 2024-08-31T12:22:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.042+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa904073cf0 con 0x7fa9040c90e0 2024-08-31T12:22:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7fa8fc100070 con 0x7fa9040c90e0 2024-08-31T12:22:34.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa8fbe00640 1 -- 172.21.15.164:0/3120407604 <== mon.0 v2:172.21.15.164:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa8fc132080 con 0x7fa9040c90e0 2024-08-31T12:22:34.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 msgr2=0x7fa8e0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 0x7fa8e0074600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009f30 tx=0x7fa8f40096a0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 msgr2=0x7fa904151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc01aed0 tx=0x7fa8fc0a5790 comp rx=0 tx=0).stop 2024-08-31T12:22:34.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 shutdown_connections 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fa8e00720f0 0x7fa8e0074600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9040c90e0 0x7fa904151470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9040c1ed0 0x7fa9041f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 --2- 172.21.15.164:0/3120407604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9040b2860 0x7fa904149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 >> 172.21.15.164:0/3120407604 conn(0x7fa9040c99b0 msgr2=0x7fa904074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 shutdown_connections 2024-08-31T12:22:34.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.050+0000 7fa90a000640 1 -- 172.21.15.164:0/3120407604 wait complete. 2024-08-31T12:22:34.072 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T12:22:34.072 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 -- 172.21.15.164:0/2495864977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0c1f40 msgr2=0x7f39cc0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 --2- 172.21.15.164:0/2495864977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0c1f40 0x7f39cc0c9330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0c9020 tx=0x7f39b401f010 comp rx=0 tx=0).stop 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 -- 172.21.15.164:0/2495864977 shutdown_connections 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 --2- 172.21.15.164:0/2495864977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0c1f40 0x7f39cc0c9330 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 --2- 172.21.15.164:0/2495864977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc15bc70 0x7f39cc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 -- 172.21.15.164:0/2495864977 >> 172.21.15.164:0/2495864977 conn(0x7f39cc0ccf20 msgr2=0x7f39cc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:34.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 -- 172.21.15.164:0/2495864977 shutdown_connections 2024-08-31T12:22:34.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.226+0000 7f39d2400640 1 -- 172.21.15.164:0/2495864977 wait complete. 2024-08-31T12:22:34.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 Processor -- start 2024-08-31T12:22:34.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- start start 2024-08-31T12:22:34.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39cc0c1f40 0x7f39cc159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 0x7f39cc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc074fb0 con 0x7f39cc15bc70 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc074e30 con 0x7f39cc0c1f40 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc0c7d30 con 0x7f39cc0c7920 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38988/0 (socket says 172.21.15.164:38988) 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 -- 172.21.15.164:0/3843406571 learned_addr learned my addr 172.21.15.164:0/3843406571 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39c2a00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 0x7f39cc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cb400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39cc0c1f40 0x7f39cc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 -- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 msgr2=0x7f39cc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 0x7f39cc155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 -- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39cc0c1f40 msgr2=0x7f39cc159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39cc0c1f40 0x7f39cc159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 -- 172.21.15.164:0/3843406571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc14fa30 con 0x7f39cc15bc70 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39c2a00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 0x7f39cc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39cbe00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c760 tx=0x7f39c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4003db0 con 0x7f39cc15bc70 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f39c400ce10 con 0x7f39cc15bc70 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40052b0 con 0x7f39cc15bc70 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc14fcf0 con 0x7f39cc15bc70 2024-08-31T12:22:34.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.230+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc154db0 con 0x7f39cc15bc70 2024-08-31T12:22:34.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc0c9330 con 0x7f39cc15bc70 2024-08-31T12:22:34.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39c4005450 con 0x7f39cc15bc70 2024-08-31T12:22:34.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39c3e00640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 0x7f39a8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f39c4092e00 con 0x7f39cc15bc70 2024-08-31T12:22:34.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39cb400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 0x7f39a8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.234+0000 7f39cb400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 0x7f39a8074600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009ad0 tx=0x7f39bc0091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:34.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.238+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f39c405dca0 con 0x7f39cc15bc70 2024-08-31T12:22:34.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.438+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39cc1560a0 con 0x7f39cc15bc70 2024-08-31T12:22:34.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.438+0000 7f39c3e00640 1 -- 172.21.15.164:0/3843406571 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6064 (secure 0 0 0) 0x7f39c4062460 con 0x7f39cc15bc70 2024-08-31T12:22:34.441 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:22:34.441 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":30,"btime":"2024-08-31T12:21:35:831353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:35.831348+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5274,"qdb_cluster":[5274]},"id":1}]} 2024-08-31T12:22:34.441 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 30 2024-08-31T12:22:34.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 msgr2=0x7f39a8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 0x7f39a8074600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009ad0 tx=0x7f39bc0091e0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 msgr2=0x7f39cc158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c760 tx=0x7f39c400cc20 comp rx=0 tx=0).stop 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 shutdown_connections 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f39a80720f0 0x7f39a8074600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc15bc70 0x7f39cc158000 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39cc0c7920 0x7f39cc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 --2- 172.21.15.164:0/3843406571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39cc0c1f40 0x7f39cc159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 >> 172.21.15.164:0/3843406571 conn(0x7f39cc0ccf20 msgr2=0x7f39cc0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:34.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 shutdown_connections 2024-08-31T12:22:34.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.442+0000 7f39d2400640 1 -- 172.21.15.164:0/3843406571 wait complete. 2024-08-31T12:22:34.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T12:22:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 -- 172.21.15.164:0/3297075487 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8820 msgr2=0x7fdf3c0c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 --2- 172.21.15.164:0/3297075487 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8820 0x7fdf3c0c3d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0ce090 tx=0x7fdf2801c800 comp rx=0 tx=0).stop 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 -- 172.21.15.164:0/3297075487 shutdown_connections 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 --2- 172.21.15.164:0/3297075487 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8820 0x7fdf3c0c3d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 --2- 172.21.15.164:0/3297075487 >> v2:172.21.15.184:3300/0 conn(0x7fdf3c0c7260 0x7fdf3c0c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 -- 172.21.15.164:0/3297075487 >> 172.21.15.164:0/3297075487 conn(0x7fdf3c0c9b00 msgr2=0x7fdf3c0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 -- 172.21.15.164:0/3297075487 shutdown_connections 2024-08-31T12:22:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.614+0000 7fdf42000640 1 -- 172.21.15.164:0/3297075487 wait complete. 2024-08-31T12:22:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 Processor -- start 2024-08-31T12:22:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 -- start start 2024-08-31T12:22:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf3c0c7260 0x7fdf3c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf3c0c8820 0x7fdf3c142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c158c90 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c152c50 con 0x7fdf3c0c7260 2024-08-31T12:22:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf42000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c158e10 con 0x7fdf3c0c8820 2024-08-31T12:22:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39008/0 (socket says 172.21.15.164:39008) 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 -- 172.21.15.164:0/3411744261 learned_addr learned my addr 172.21.15.164:0/3411744261 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf3be00640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf3c0c8820 0x7fdf3c142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf40c00640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf3c0c7260 0x7fdf3c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 -- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf3c0c8820 msgr2=0x7fdf3c142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf3c0c8820 0x7fdf3c142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 -- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf3c0c7260 msgr2=0x7fdf3c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf3c0c7260 0x7fdf3c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.618+0000 7fdf41600640 1 -- 172.21.15.164:0/3411744261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c146e20 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf41600640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c6b0 tx=0x7fdf3400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34017070 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fdf34003b80 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf340050f0 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c1580d0 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c155b40 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c147130 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdf3401a070 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 0x7fdf1c0745f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7fdf340925d0 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.622+0000 7fdf40c00640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 0x7fdf1c0745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.626+0000 7fdf40c00640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 0x7fdf1c0745f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009b40 tx=0x7fdf300091e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.630+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdf3405d3f0 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.830+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf3c0c2020 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf38c00640 1 -- 172.21.15.164:0/3411744261 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6064 (secure 0 0 0) 0x7fdf34061bb0 con 0x7fdf3c0c8d90 2024-08-31T12:22:34.834 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:22:34.834 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":30,"btime":"2024-08-31T12:21:35:831353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6838/3699696204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3699696204},{"type":"v1","addr":"172.21.15.184:6838","nonce":3699696204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/3774379211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3774379211},{"type":"v1","addr":"172.21.15.184:6839","nonce":3774379211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4317,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3562834666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3562834666},{"type":"v1","addr":"172.21.15.164:6833","nonce":3562834666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2838802595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":2838802595},{"type":"v1","addr":"172.21.15.164:6837","nonce":2838802595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T12:13:46.068757+0000","modified":"2024-08-31T12:21:35.831348+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.164:6835/2530648468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2530648468},{"type":"v1","addr":"172.21.15.164:6835","nonce":2530648468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5274,"qdb_cluster":[5274]},"id":1}]} 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 30 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 msgr2=0x7fdf1c0745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 0x7fdf1c0745f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009b40 tx=0x7fdf300091e0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 msgr2=0x7fdf3c142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c6b0 tx=0x7fdf3400cb70 comp rx=0 tx=0).stop 2024-08-31T12:22:34.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 shutdown_connections 2024-08-31T12:22:34.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fdf1c0720e0 0x7fdf1c0745f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf3c0c8d90 0x7fdf3c142c60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf3c0c8820 0x7fdf3c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 --2- 172.21.15.164:0/3411744261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf3c0c7260 0x7fdf3c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:34.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 >> 172.21.15.164:0/3411744261 conn(0x7fdf3c0c9b00 msgr2=0x7fdf3c0caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:34.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 shutdown_connections 2024-08-31T12:22:34.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:34.834+0000 7fdf42000640 1 -- 172.21.15.164:0/3411744261 wait complete. 2024-08-31T12:22:34.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:22:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 -- 172.21.15.164:0/1635677509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e3c003a40 msgr2=0x7f3e3c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1635677509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e3c003a40 0x7f3e3c003eb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009b40 tx=0x7f3e4801d270 comp rx=0 tx=0).stop 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5d000640 1 -- 172.21.15.164:0/1635677509 reap_dead start 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 -- 172.21.15.164:0/1635677509 shutdown_connections 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 -- 172.21.15.164:0/1635677509 >> 172.21.15.164:0/1635677509 conn(0x7f3e580ccf20 msgr2=0x7f3e580cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 -- 172.21.15.164:0/1635677509 shutdown_connections 2024-08-31T12:22:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 -- 172.21.15.164:0/1635677509 wait complete. 2024-08-31T12:22:35.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.010+0000 7f3e5f000640 1 Processor -- start 2024-08-31T12:22:35.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- start start 2024-08-31T12:22:35.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 0x7f3e58153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 0x7f3e580738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3e580c8030 con 0x7f3e580b2310 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e580c3150 con 0x7f3e3c003a40 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3e58074e30 con 0x7f3e58157a20 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39014/0 (socket says 172.21.15.164:39014) 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 -- 172.21.15.164:0/1849057572 learned_addr learned my addr 172.21.15.164:0/1849057572 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5d000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 0x7f3e580738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57e00640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 0x7f3e58153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 -- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 msgr2=0x7f3e580738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 0x7f3e580738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 -- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 msgr2=0x7f3e58153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 0x7f3e58153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 -- 172.21.15.164:0/1849057572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e58156c60 con 0x7f3e580b2310 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57e00640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 0x7f3e58153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5d000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 0x7f3e580738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e57400640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001750 tx=0x7f3e4400e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44012850 con 0x7f3e580b2310 2024-08-31T12:22:35.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3e44012b20 con 0x7f3e580b2310 2024-08-31T12:22:35.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e58156f40 con 0x7f3e580b2310 2024-08-31T12:22:35.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4401a400 con 0x7f3e580b2310 2024-08-31T12:22:35.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.014+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e58157500 con 0x7f3e580b2310 2024-08-31T12:22:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e58152a10 con 0x7f3e580b2310 2024-08-31T12:22:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3e4400d030 con 0x7f3e580b2310 2024-08-31T12:22:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e4fe00640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 0x7f3e38074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f3e440960f0 con 0x7f3e580b2310 2024-08-31T12:22:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e57e00640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 0x7f3e38074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.018+0000 7f3e57e00640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 0x7f3e38074600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ad000 tx=0x7f3e3c005840 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.022+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3e44016030 con 0x7f3e580b2310 2024-08-31T12:22:35.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.190+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e581560a0 con 0x7f3e580b2310 2024-08-31T12:22:35.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.190+0000 7f3e4fe00640 1 -- 172.21.15.164:0/1849057572 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+19330 (secure 0 0 0) 0x7f3e44061600 con 0x7f3e580b2310 2024-08-31T12:22:35.192 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-08-31T12:22:35.193 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":56,"fsid":"0ef23008-1eb0-48b8-823b-3324ee9f8086","created":"2024-08-31T12:13:21.579776+0000","modified":"2024-08-31T12:21:16.365692+0000","last_up_change":"2024-08-31T12:13:35.495931+0000","last_in_change":"2024-08-31T12:13:25.072710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:13:36.572013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:13:44.435605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:13:45.013335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T12:13:48.695161+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c2135650-6ddb-4dd6-a43b-8d9d05af38e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6809","nonce":624071425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6811","nonce":624071425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6815","nonce":624071425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":624071425},{"type":"v1","addr":"172.21.15.164:6813","nonce":624071425}]},"public_addr":"172.21.15.164:6809/624071425","cluster_addr":"172.21.15.164:6811/624071425","heartbeat_back_addr":"172.21.15.164:6815/624071425","heartbeat_front_addr":"172.21.15.164:6813/624071425","state":["exists","up"]},{"osd":1,"uuid":"12a93725-8483-4772-8eb2-9fb1f1318ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6817","nonce":1467060278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1467060278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1467060278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1467060278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1467060278}]},"public_addr":"172.21.15.164:6817/1467060278","cluster_addr":"172.21.15.164:6819/1467060278","heartbeat_back_addr":"172.21.15.164:6823/1467060278","heartbeat_front_addr":"172.21.15.164:6821/1467060278","state":["exists","up"]},{"osd":2,"uuid":"4ef1de51-2d58-4039-a9dd-1cd168f6cc32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6825","nonce":3066810189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6827","nonce":3066810189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6831","nonce":3066810189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3066810189},{"type":"v1","addr":"172.21.15.164:6829","nonce":3066810189}]},"public_addr":"172.21.15.164:6825/3066810189","cluster_addr":"172.21.15.164:6827/3066810189","heartbeat_back_addr":"172.21.15.164:6831/3066810189","heartbeat_front_addr":"172.21.15.164:6829/3066810189","state":["exists","up"]},{"osd":3,"uuid":"14543401-3751-44a4-8ff5-79479ad4d8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6801","nonce":2906760086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6803","nonce":2906760086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6807","nonce":2906760086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2906760086},{"type":"v1","addr":"172.21.15.164:6805","nonce":2906760086}]},"public_addr":"172.21.15.164:6801/2906760086","cluster_addr":"172.21.15.164:6803/2906760086","heartbeat_back_addr":"172.21.15.164:6807/2906760086","heartbeat_front_addr":"172.21.15.164:6805/2906760086","state":["exists","up"]},{"osd":4,"uuid":"edb46cb9-a605-49a8-99ad-3f817fe9935d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6801","nonce":4127972505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6803","nonce":4127972505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6807","nonce":4127972505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":4127972505},{"type":"v1","addr":"172.21.15.184:6805","nonce":4127972505}]},"public_addr":"172.21.15.184:6801/4127972505","cluster_addr":"172.21.15.184:6803/4127972505","heartbeat_back_addr":"172.21.15.184:6807/4127972505","heartbeat_front_addr":"172.21.15.184:6805/4127972505","state":["exists","up"]},{"osd":5,"uuid":"2d1883af-14c8-47d3-9702-4c2f05b77c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6811","nonce":3751959683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6813","nonce":3751959683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6817","nonce":3751959683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3751959683},{"type":"v1","addr":"172.21.15.184:6815","nonce":3751959683}]},"public_addr":"172.21.15.184:6811/3751959683","cluster_addr":"172.21.15.184:6813/3751959683","heartbeat_back_addr":"172.21.15.184:6817/3751959683","heartbeat_front_addr":"172.21.15.184:6815/3751959683","state":["exists","up"]},{"osd":6,"uuid":"e289e257-cfc1-4bbc-ad1a-fae5f6349c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6827","nonce":1165040551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6829","nonce":1165040551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6833","nonce":1165040551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1165040551},{"type":"v1","addr":"172.21.15.184:6831","nonce":1165040551}]},"public_addr":"172.21.15.184:6827/1165040551","cluster_addr":"172.21.15.184:6829/1165040551","heartbeat_back_addr":"172.21.15.184:6833/1165040551","heartbeat_front_addr":"172.21.15.184:6831/1165040551","state":["exists","up"]},{"osd":7,"uuid":"a10b01a1-7e99-4616-baea-699c37eb9ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6819","nonce":3185978825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6821","nonce":3185978825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6825","nonce":3185978825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3185978825},{"type":"v1","addr":"172.21.15.184:6823","nonce":3185978825}]},"public_addr":"172.21.15.184:6819/3185978825","cluster_addr":"172.21.15.184:6821/3185978825","heartbeat_back_addr":"172.21.15.184:6825/3185978825","heartbeat_front_addr":"172.21.15.184:6823/3185978825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.075901+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.322883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.531090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.477417+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.447426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:31.684094+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.440403+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:13:32.136989+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6834/4233946054":"2024-09-01T12:21:16.365631+0000","172.21.15.184:6837/4233946054":"2024-09-01T12:21:16.365631+0000","172.21.15.164:6835/580774116":"2024-09-01T12:20:26.356943+0000","172.21.15.164:6834/580774116":"2024-09-01T12:20:26.356943+0000","172.21.15.184:6837/1093030453":"2024-09-01T12:19:21.343788+0000","172.21.15.184:6834/1093030453":"2024-09-01T12:19:21.343788+0000","172.21.15.164:6835/2031819890":"2024-09-01T12:16:31.307712+0000","172.21.15.164:6834/2031819890":"2024-09-01T12:16:31.307712+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 msgr2=0x7f3e38074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 0x7f3e38074600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ad000 tx=0x7f3e3c005840 comp rx=0 tx=0).stop 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 msgr2=0x7f3e5815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001750 tx=0x7f3e4400e6b0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 shutdown_connections 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f3e380720f0 0x7f3e38074600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e58157a20 0x7f3e580738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e580b2310 0x7f3e5815b4f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 --2- 172.21.15.164:0/1849057572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e3c003a40 0x7f3e58153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 >> 172.21.15.164:0/1849057572 conn(0x7f3e580ccf20 msgr2=0x7f3e580c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 shutdown_connections 2024-08-31T12:22:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.194+0000 7f3e5f000640 1 -- 172.21.15.164:0/1849057572 wait complete. 2024-08-31T12:22:35.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-31T12:22:35.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- 172.21.15.164:0/2958854107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 msgr2=0x7f95e8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 --2- 172.21.15.164:0/2958854107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8152a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009900 tx=0x7f95dc01f0d0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- 172.21.15.164:0/2958854107 shutdown_connections 2024-08-31T12:22:35.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 --2- 172.21.15.164:0/2958854107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c9330 0x7f95e8074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 --2- 172.21.15.164:0/2958854107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8152a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- 172.21.15.164:0/2958854107 >> 172.21.15.164:0/2958854107 conn(0x7f95e80ccf20 msgr2=0x7f95e80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:35.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- 172.21.15.164:0/2958854107 shutdown_connections 2024-08-31T12:22:35.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- 172.21.15.164:0/2958854107 wait complete. 2024-08-31T12:22:35.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 Processor -- start 2024-08-31T12:22:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.370+0000 7f95efe00640 1 -- start start 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c1f40 0x7f95e814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80c8030 con 0x7f95e80c9330 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80c3150 con 0x7f95e815bc70 2024-08-31T12:22:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f95e8074c60 con 0x7f95e80c1f40 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39022/0 (socket says 172.21.15.164:39022) 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 -- 172.21.15.164:0/626590849 learned_addr learned my addr 172.21.15.164:0/626590849 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95ed400640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c1f40 0x7f95e814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95ede00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 -- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c1f40 msgr2=0x7f95e814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c1f40 0x7f95e814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 -- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 msgr2=0x7f95e8073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 -- 172.21.15.164:0/626590849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e81efea0 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95eca00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c3c0 tx=0x7f95d400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4017070 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f95d40052d0 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e81f0890 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4003860 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e81565a0 con 0x7f95e80c9330 2024-08-31T12:22:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.374+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e8074720 con 0x7f95e80c9330 2024-08-31T12:22:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.378+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f95d401a070 con 0x7f95e80c9330 2024-08-31T12:22:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.378+0000 7f95e5600640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 0x7f95c8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.378+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6934+0+0 (secure 0 0 0) 0x7f95d4092300 con 0x7f95e80c9330 2024-08-31T12:22:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.378+0000 7f95ed400640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 0x7f95c8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.378+0000 7f95ed400640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 0x7f95c8074600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0b2000 tx=0x7f95dc0ab040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.382+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f95d405d120 con 0x7f95e80c9330 2024-08-31T12:22:35.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.582+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f95e80c82f0 con 0x7f95e80c9330 2024-08-31T12:22:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.582+0000 7f95e5600640 1 -- 172.21.15.164:0/626590849 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f95d40618e0 con 0x7f95e80c9330 2024-08-31T12:22:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 msgr2=0x7f95c8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 0x7f95c8074600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0b2000 tx=0x7f95dc0ab040 comp rx=0 tx=0).stop 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 msgr2=0x7f95e81f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c3c0 tx=0x7f95d400c7c0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 shutdown_connections 2024-08-31T12:22:35.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f95c80720f0 0x7f95c8074600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e815bc70 0x7f95e8073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95e80c9330 0x7f95e81f0350 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 --2- 172.21.15.164:0/626590849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95e80c1f40 0x7f95e814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 >> 172.21.15.164:0/626590849 conn(0x7f95e80ccf20 msgr2=0x7f95e814fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 shutdown_connections 2024-08-31T12:22:35.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.586+0000 7f95efe00640 1 -- 172.21.15.164:0/626590849 wait complete. 2024-08-31T12:22:35.604 INFO:tasks.ceph.mds.a.smithi164.stderr: -6744> 2024-08-31T12:21:43.819+0000 7f4278800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:22:35.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T12:22:35.731 INFO:tasks.ceph.mds.a.smithi164.stdout:starting mds.a at 2024-08-31T12:22:35.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 -- 172.21.15.164:0/746541191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc151dc0 msgr2=0x7fc5dc0749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 --2- 172.21.15.164:0/746541191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc0749d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00aa10 tx=0x7fc5cc020420 comp rx=0 tx=0).stop 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 -- 172.21.15.164:0/746541191 shutdown_connections 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 --2- 172.21.15.164:0/746541191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 0x7fc5dc070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 --2- 172.21.15.164:0/746541191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc0749d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 -- 172.21.15.164:0/746541191 >> 172.21.15.164:0/746541191 conn(0x7fc5dc0c99b0 msgr2=0x7fc5dc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 -- 172.21.15.164:0/746541191 shutdown_connections 2024-08-31T12:22:35.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.770+0000 7fc5e1400640 1 -- 172.21.15.164:0/746541191 wait complete. 2024-08-31T12:22:35.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 Processor -- start 2024-08-31T12:22:35.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- start start 2024-08-31T12:22:35.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc1e8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 0x7fc5dc145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc0c2770 con 0x7fc5dc06fd80 2024-08-31T12:22:35.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc0c2490 con 0x7fc5dc151dc0 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc1521d0 con 0x7fc5dc1588b0 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47196/0 (socket says 172.21.15.164:47196) 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 -- 172.21.15.164:0/3010371612 learned_addr learned my addr 172.21.15.164:0/3010371612 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5db200640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 0x7fc5dc145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5d1e00640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc1e8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 -- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 msgr2=0x7fc5dc145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 0x7fc5dc145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 -- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc151dc0 msgr2=0x7fc5dc1e8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc1e8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 -- 172.21.15.164:0/3010371612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc150c90 con 0x7fc5dc06fd80 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5da800640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00a960 tx=0x7fc5cc005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0bf070 con 0x7fc5dc06fd80 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc5cc0b0bd0 con 0x7fc5dc06fd80 2024-08-31T12:22:35.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0b5040 con 0x7fc5dc06fd80 2024-08-31T12:22:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5dc1f5e90 con 0x7fc5dc06fd80 2024-08-31T12:22:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.774+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5dc1f6150 con 0x7fc5dc06fd80 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5dc150350 con 0x7fc5dc06fd80 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc5cc0b0580 con 0x7fc5dc06fd80 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5d3400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 0x7fc5b80745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7020+0+0 (secure 0 0 0) 0x7fc5cc1306c0 con 0x7fc5dc06fd80 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5d1e00640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 0x7fc5b80745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.778+0000 7fc5d1e00640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 0x7fc5b80745c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0cc330 tx=0x7fc5c4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.782+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc5cc019f80 con 0x7fc5dc06fd80 2024-08-31T12:22:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:35.982+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc5dc0ca330 con 0x7fc5dc06fd80 2024-08-31T12:22:36.182 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:36.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:36.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.586+0000 7fc5d3400640 1 -- 172.21.15.164:0/3010371612 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7fc5cc0fba50 con 0x7fc5dc06fd80 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 msgr2=0x7fc5b80745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 0x7fc5b80745c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0cc330 tx=0x7fc5c4009040 comp rx=0 tx=0).stop 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 msgr2=0x7fc5dc150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00a960 tx=0x7fc5cc005e70 comp rx=0 tx=0).stop 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 shutdown_connections 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fc5b80720b0 0x7fc5b80745c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc1588b0 0x7fc5dc145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc151dc0 0x7fc5dc1e8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 --2- 172.21.15.164:0/3010371612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5dc06fd80 0x7fc5dc150750 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 >> 172.21.15.164:0/3010371612 conn(0x7fc5dc0c99b0 msgr2=0x7fc5dc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 shutdown_connections 2024-08-31T12:22:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.590+0000 7fc5e1400640 1 -- 172.21.15.164:0/3010371612 wait complete. 2024-08-31T12:22:36.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T12:22:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 -- 172.21.15.164:0/3535742389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 msgr2=0x7f54400c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 --2- 172.21.15.164:0/3535742389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f54400c3d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5430009900 tx=0x7f543001c900 comp rx=0 tx=0).stop 2024-08-31T12:22:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 -- 172.21.15.164:0/3535742389 shutdown_connections 2024-08-31T12:22:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 --2- 172.21.15.164:0/3535742389 >> v2:172.21.15.184:3300/0 conn(0x7f54400c8560 0x7f54400c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 --2- 172.21.15.164:0/3535742389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f54400c3d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 -- 172.21.15.164:0/3535742389 >> 172.21.15.164:0/3535742389 conn(0x7f54400ccf20 msgr2=0x7f54400cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:36.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 -- 172.21.15.164:0/3535742389 shutdown_connections 2024-08-31T12:22:36.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.770+0000 7f5447c00640 1 -- 172.21.15.164:0/3535742389 wait complete. 2024-08-31T12:22:36.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 Processor -- start 2024-08-31T12:22:36.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 -- start start 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f5440145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54400c8560 0x7f5440144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5440165b30 con 0x7f54400c94a0 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f54401659b0 con 0x7f54400c8560 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5447c00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5440165cb0 con 0x7f5440074fb0 2024-08-31T12:22:36.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47200/0 (socket says 172.21.15.164:47200) 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 -- 172.21.15.164:0/1658212884 learned_addr learned my addr 172.21.15.164:0/1658212884 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445200640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f5440145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5437e00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54400c8560 0x7f5440144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 -- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 msgr2=0x7f5440145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f5440145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 -- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54400c8560 msgr2=0x7f5440144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:36.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54400c8560 0x7f5440144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.774+0000 7f5445c00640 1 -- 172.21.15.164:0/1658212884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5440146350 con 0x7f54400c94a0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f5445c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f543800ec70 tx=0x7f543800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438003b80 con 0x7f54400c94a0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5440151bd0 con 0x7f54400c94a0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f5438003e30 con 0x7f54400c94a0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438004240 con 0x7f54400c94a0 2024-08-31T12:22:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401627b0 con 0x7f54400c94a0 2024-08-31T12:22:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54400c3d80 con 0x7f54400c94a0 2024-08-31T12:22:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f54380043e0 con 0x7f54400c94a0 2024-08-31T12:22:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.778+0000 7f543d600640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 0x7f541c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.782+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7020+0+0 (secure 0 0 0) 0x7f5438094080 con 0x7f54400c94a0 2024-08-31T12:22:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.782+0000 7f5445200640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 0x7f541c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.782+0000 7f5445200640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 0x7f541c0745d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54300af000 tx=0x7f54300196a0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.782+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f543805f4b0 con 0x7f54400c94a0 2024-08-31T12:22:36.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:36.950+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5440070dc0 con 0x7f54400c94a0 2024-08-31T12:22:37.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.594+0000 7f543d600640 1 -- 172.21.15.164:0/1658212884 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) ==== 181+0+0 (secure 0 0 0) 0x7f543805edb0 con 0x7f54400c94a0 2024-08-31T12:22:37.596 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_metadata' removed 2024-08-31T12:22:37.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 msgr2=0x7f541c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 0x7f541c0745d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54300af000 tx=0x7f54300196a0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 msgr2=0x7f54400cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f543800ec70 tx=0x7f543800c6a0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 shutdown_connections 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f541c0720c0 0x7f541c0745d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54400c94a0 0x7f54400cbff0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54400c8560 0x7f5440144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 --2- 172.21.15.164:0/1658212884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5440074fb0 0x7f5440145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 >> 172.21.15.164:0/1658212884 conn(0x7f54400ccf20 msgr2=0x7f54400ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:37.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 shutdown_connections 2024-08-31T12:22:37.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.598+0000 7f5447c00640 1 -- 172.21.15.164:0/1658212884 wait complete. 2024-08-31T12:22:37.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T12:22:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 -- 172.21.15.164:0/635854510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb678004d50 msgr2=0x7fb678005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 --2- 172.21.15.164:0/635854510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb678004d50 0x7fb678005160 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb6940753f0 tx=0x7fb68c01d2a0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb692800640 1 -- 172.21.15.164:0/635854510 reap_dead start 2024-08-31T12:22:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 -- 172.21.15.164:0/635854510 shutdown_connections 2024-08-31T12:22:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 -- 172.21.15.164:0/635854510 >> 172.21.15.164:0/635854510 conn(0x7fb6940ccf20 msgr2=0x7fb6940cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 -- 172.21.15.164:0/635854510 shutdown_connections 2024-08-31T12:22:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.786+0000 7fb699200640 1 -- 172.21.15.164:0/635854510 wait complete. 2024-08-31T12:22:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 Processor -- start 2024-08-31T12:22:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 -- start start 2024-08-31T12:22:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb678004d50 0x7fb6941533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 0x7fb694158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940c8030 con 0x7fb694155d40 2024-08-31T12:22:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb694071440 con 0x7fb694155620 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb699200640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb6940c81b0 con 0x7fb678004d50 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47218/0 (socket says 172.21.15.164:47218) 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 -- 172.21.15.164:0/2308213761 learned_addr learned my addr 172.21.15.164:0/2308213761 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb691e00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb678004d50 0x7fb6941533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb692800640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 0x7fb694158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 -- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb678004d50 msgr2=0x7fb6941533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb678004d50 0x7fb6941533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 -- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 msgr2=0x7fb694158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 0x7fb694158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 -- 172.21.15.164:0/2308213761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941538f0 con 0x7fb694155d40 2024-08-31T12:22:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb692800640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 0x7fb694158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:22:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.790+0000 7fb68be00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011780 tx=0x7fb67c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c01f070 con 0x7fb694155d40 2024-08-31T12:22:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb67c00fd50 con 0x7fb694155d40 2024-08-31T12:22:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0126b0 con 0x7fb694155d40 2024-08-31T12:22:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb694156610 con 0x7fb694155d40 2024-08-31T12:22:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb694156b90 con 0x7fb694155d40 2024-08-31T12:22:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6940c3d80 con 0x7fb694155d40 2024-08-31T12:22:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb67c022070 con 0x7fb694155d40 2024-08-31T12:22:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 0x7fb670074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.794+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6582+0+0 (secure 0 0 0) 0x7fb67c093940 con 0x7fb694155d40 2024-08-31T12:22:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.798+0000 7fb691e00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 0x7fb670074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.798+0000 7fb691e00640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 0x7fb670074600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb684005fd0 tx=0x7fb6840093d0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.802+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb67c05e840 con 0x7fb694155d40 2024-08-31T12:22:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:37.966+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb694073990 con 0x7fb694155d40 2024-08-31T12:22:38.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb68a000640 1 -- 172.21.15.164:0/2308213761 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) ==== 169+0+0 (secure 0 0 0) 0x7fb67c0673d0 con 0x7fb694155d40 2024-08-31T12:22:38.598 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data' removed 2024-08-31T12:22:38.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 msgr2=0x7fb670074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 0x7fb670074600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb684005fd0 tx=0x7fb6840093d0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 msgr2=0x7fb6940c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011780 tx=0x7fb67c011c40 comp rx=0 tx=0).stop 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 shutdown_connections 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7fb6700720f0 0x7fb670074600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb694155620 0x7fb694158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb694155d40 0x7fb6940c51b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 --2- 172.21.15.164:0/2308213761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb678004d50 0x7fb6941533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.598+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 >> 172.21.15.164:0/2308213761 conn(0x7fb6940ccf20 msgr2=0x7fb694150880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:38.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.602+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 shutdown_connections 2024-08-31T12:22:38.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.602+0000 7fb699200640 1 -- 172.21.15.164:0/2308213761 wait complete. 2024-08-31T12:22:38.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-31T12:22:38.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.786+0000 7f1371600640 1 -- 172.21.15.164:0/3573307851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c156c00 msgr2=0x7f136c0cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.786+0000 7f1371600640 1 --2- 172.21.15.164:0/3573307851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c156c00 0x7f136c0cb870 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f136c0c3fc0 tx=0x7f135c01cba0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 -- 172.21.15.164:0/3573307851 shutdown_connections 2024-08-31T12:22:38.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 --2- 172.21.15.164:0/3573307851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c157010 0x7f136c0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 --2- 172.21.15.164:0/3573307851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c156c00 0x7f136c0cb870 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 -- 172.21.15.164:0/3573307851 >> 172.21.15.164:0/3573307851 conn(0x7f136c071a70 msgr2=0x7f136c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:38.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 -- 172.21.15.164:0/3573307851 shutdown_connections 2024-08-31T12:22:38.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 -- 172.21.15.164:0/3573307851 wait complete. 2024-08-31T12:22:38.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 Processor -- start 2024-08-31T12:22:38.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.790+0000 7f1371600640 1 -- start start 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c156c00 0x7f136c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 0x7f136c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0ccc80 con 0x7f136c0cbdb0 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0cd950 con 0x7f136c15ca80 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f136c0ccff0 con 0x7f136c156c00 2024-08-31T12:22:38.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47240/0 (socket says 172.21.15.164:47240) 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 -- 172.21.15.164:0/74035576 learned_addr learned my addr 172.21.15.164:0/74035576 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1362000640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c156c00 0x7f136c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136b400640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 0x7f136c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 -- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c156c00 msgr2=0x7f136c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c156c00 0x7f136c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 -- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 msgr2=0x7f136c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 0x7f136c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 -- 172.21.15.164:0/74035576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c1f47f0 con 0x7f136c0cbdb0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136b400640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 0x7f136c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f136aa00640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f135c000f90 tx=0x7f135c0a58f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0bb070 con 0x7f136c0cbdb0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f135c004e20 con 0x7f136c0cbdb0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0b2040 con 0x7f136c0cbdb0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c149520 con 0x7f136c0cbdb0 2024-08-31T12:22:38.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c1f7d60 con 0x7f136c0cbdb0 2024-08-31T12:22:38.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136c157010 con 0x7f136c0cbdb0 2024-08-31T12:22:38.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.794+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f135c004320 con 0x7f136c0cbdb0 2024-08-31T12:22:38.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.798+0000 7f1363400640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:38.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.798+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6139+0+0 (secure 0 0 0) 0x7f135c12cb10 con 0x7f136c0cbdb0 2024-08-31T12:22:38.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.798+0000 7f1362000640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:38.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.798+0000 7f1362000640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13540058d0 tx=0x7f1354005860 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:38.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.802+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f135c016790 con 0x7f136c0cbdb0 2024-08-31T12:22:38.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:38.970+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f136c0c9ca0 con 0x7f136c0cbdb0 2024-08-31T12:22:39.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.622+0000 7f1363400640 1 -- 172.21.15.164:0/74035576 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v60) ==== 178+0+0 (secure 0 0 0) 0x7f135c0f7bd0 con 0x7f136c0cbdb0 2024-08-31T12:22:39.623 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data_ec' removed 2024-08-31T12:22:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 msgr2=0x7f13480745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13540058d0 tx=0x7f1354005860 comp rx=0 tx=0).stop 2024-08-31T12:22:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 msgr2=0x7f136c1f8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f135c000f90 tx=0x7f135c0a58f0 comp rx=0 tx=0).stop 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 shutdown_connections 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:6808/1260951868,v1:172.21.15.184:6809/1260951868] conn(0x7f13480720c0 0x7f13480745d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f136c15ca80 0x7f136c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f136c156c00 0x7f136c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 --2- 172.21.15.164:0/74035576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136c0cbdb0 0x7f136c1f8840 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:39.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.626+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 >> 172.21.15.164:0/74035576 conn(0x7f136c071a70 msgr2=0x7f136c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:39.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.630+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 shutdown_connections 2024-08-31T12:22:39.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-08-31T12:22:39.630+0000 7f1371600640 1 -- 172.21.15.164:0/74035576 wait complete. 2024-08-31T12:22:39.660 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-31T12:22:39.660 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-31T12:22:39.660 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.679 INFO:tasks.ceph.mds.a:Stopped 2024-08-31T12:22:39.680 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-31T12:22:39.680 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.735 INFO:tasks.ceph.mds.c:Stopped 2024-08-31T12:22:39.736 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-08-31T12:22:39.736 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.792 INFO:tasks.ceph.mds.e:Stopped 2024-08-31T12:22:39.793 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-31T12:22:39.793 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.818 INFO:tasks.ceph.mds.b:Stopped 2024-08-31T12:22:39.818 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-08-31T12:22:39.824 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-08-31T12:22:39.824 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.875 INFO:tasks.ceph.mds.f:Stopped 2024-08-31T12:22:39.876 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-31T12:22:39.876 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-31T12:22:39.876 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:39.958 INFO:tasks.ceph.osd.0:Stopped 2024-08-31T12:22:39.958 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-31T12:22:39.958 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:40.047 INFO:tasks.ceph.osd.1:Stopped 2024-08-31T12:22:40.047 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-31T12:22:40.048 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:42.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-08-31T12:22:46.149 INFO:tasks.ceph.osd.2:Stopped 2024-08-31T12:22:46.150 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-31T12:22:46.150 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.243 INFO:tasks.ceph.osd.3:Stopped 2024-08-31T12:22:46.243 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-31T12:22:46.243 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.332 INFO:tasks.ceph.osd.4:Stopped 2024-08-31T12:22:46.332 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-31T12:22:46.332 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.420 INFO:tasks.ceph.osd.5:Stopped 2024-08-31T12:22:46.420 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-31T12:22:46.420 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.518 INFO:tasks.ceph.osd.6:Stopped 2024-08-31T12:22:46.519 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-31T12:22:46.519 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.603 INFO:tasks.ceph.osd.7:Stopped 2024-08-31T12:22:46.604 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-31T12:22:46.604 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-31T12:22:46.604 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.666 INFO:tasks.ceph.mgr.y:Stopped 2024-08-31T12:22:46.667 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-31T12:22:46.667 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.697 INFO:tasks.ceph.mgr.x:Stopped 2024-08-31T12:22:46.698 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-31T12:22:46.698 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-31T12:22:46.698 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.717 INFO:tasks.ceph.mon.a:Stopped 2024-08-31T12:22:46.718 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-31T12:22:46.718 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.765 INFO:tasks.ceph.mon.b:Stopped 2024-08-31T12:22:46.765 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-31T12:22:46.765 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:22:46.822 INFO:tasks.ceph.mon.c:Stopped 2024-08-31T12:22:46.822 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-31T12:22:46.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'Replacing daemon mds' | head -n 1 2024-08-31T12:22:46.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:22:46.874 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-31T12:22:47.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:22:47.365 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-31T12:22:47.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-08-31T12:22:47.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:22:47.648 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-31T12:22:47.837 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:22:47.837 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-31T12:22:48.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:22:48.062 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-31T12:22:48.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:22:48.432 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-31T12:22:48.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:22:48.774 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-31T12:22:48.954 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:22:48.954 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-31T12:22:49.129 INFO:tasks.ceph:Archiving mon data... 2024-08-31T12:22:49.130 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/data/mon.a.tgz 2024-08-31T12:22:49.130 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-08-31T12:22:49.139 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.3u6J7lSQ2r 2024-08-31T12:22:49.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3u6J7lSQ2r 2024-08-31T12:22:49.263 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.3u6J7lSQ2r 2024-08-31T12:22:49.336 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.3u6J7lSQ2r is 324KB 2024-08-31T12:22:49.398 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.3u6J7lSQ2r 2024-08-31T12:22:49.406 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/data/mon.b.tgz 2024-08-31T12:22:49.406 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-08-31T12:22:49.412 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.s84HlfDlct 2024-08-31T12:22:49.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.s84HlfDlct 2024-08-31T12:22:49.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.s84HlfDlct 2024-08-31T12:22:49.595 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.s84HlfDlct is 327KB 2024-08-31T12:22:49.611 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.s84HlfDlct 2024-08-31T12:22:49.616 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/data/mon.c.tgz 2024-08-31T12:22:49.616 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-08-31T12:22:49.666 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.26owv4daaB 2024-08-31T12:22:49.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.26owv4daaB 2024-08-31T12:22:49.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.26owv4daaB 2024-08-31T12:22:49.850 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.26owv4daaB is 328KB 2024-08-31T12:22:49.911 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.26owv4daaB 2024-08-31T12:22:49.917 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-31T12:22:49.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-31T12:22:49.920 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-31T12:22:49.988 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-31T12:22:50.026 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-31T12:22:50.026 INFO:tasks.ceph:Archiving crash dumps... 2024-08-31T12:22:50.027 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi164/crash 2024-08-31T12:22:50.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-31T12:22:50.051 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi184/crash 2024-08-31T12:22:50.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-31T12:22:50.085 INFO:tasks.ceph:Shutting down logrotate 2024-08-31T12:22:50.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:50.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:50.171 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:50.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-31T12:22:50.224 INFO:tasks.ceph:Compressing logs... 2024-08-31T12:22:50.224 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T12:22:50.242 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T12:22:50.258 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41391.log 2024-08-31T12:22:50.258 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40062.log 2024-08-31T12:22:50.259 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35134.log 2024-08-31T12:22:50.260 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41391.log.gz 2024-08-31T12:22:50.260 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36069.log 2024-08-31T12:22:50.260 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40062.log.gz 2024-08-31T12:22:50.261 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35719.log 2024-08-31T12:22:50.261 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35134.log.gz 2024-08-31T12:22:50.262 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2024-08-31T12:22:50.263 INFO:teuthology.orchestra.run.smithi164.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36069.log.gz 2024-08-31T12:22:50.263 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29366.log 2024-08-31T12:22:50.263 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35719.log.gz 2024-08-31T12:22:50.264 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34747.log 2024-08-31T12:22:50.264 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2024-08-31T12:22:50.265 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-08-31T12:22:50.265 INFO:teuthology.orchestra.run.smithi164.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29366.log.gz 2024-08-31T12:22:50.265 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34747.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-31T12:22:50.266 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34747.log.gz 2024-08-31T12:22:50.266 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-08-31T12:22:50.267 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-08-31T12:22:50.267 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36287.log 2024-08-31T12:22:50.267 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-08-31T12:22:50.268 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-08-31T12:22:50.268 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36081.log 2024-08-31T12:22:50.268 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36287.log.gz 2024-08-31T12:22:50.269 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36077.log 2024-08-31T12:22:50.270 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-08-31T12:22:50.271 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36081.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36081.log.gz -5 2024-08-31T12:22:50.271 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-08-31T12:22:50.271 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-08-31T12:22:50.272 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36077.log.gz 2024-08-31T12:22:50.272 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-08-31T12:22:50.272 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-08-31T12:22:50.274 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42122.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-31T12:22:50.274 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39981.log 2024-08-31T12:22:50.275 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-08-31T12:22:50.275 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40845.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-31T12:22:50.275 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-08-31T12:22:50.275 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41499.log 2024-08-31T12:22:50.275 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39981.log.gz 2024-08-31T12:22:50.276 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-08-31T12:22:50.277 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35860.log 2024-08-31T12:22:50.277 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41499.log.gz 2024-08-31T12:22:50.277 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34885.log 2024-08-31T12:22:50.277 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-08-31T12:22:50.278 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41966.log 2024-08-31T12:22:50.278 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35860.log.gz 2024-08-31T12:22:50.278 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34859.log 2024-08-31T12:22:50.279 INFO:teuthology.orchestra.run.smithi164.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34885.log.gz 2024-08-31T12:22:50.279 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34913.log 2024-08-31T12:22:50.279 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41966.log.gz 2024-08-31T12:22:50.281 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-08-31T12:22:50.281 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34859.log.gz 2024-08-31T12:22:50.281 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34941.log 2024-08-31T12:22:50.281 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34913.log.gz 2024-08-31T12:22:50.282 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34975.log 2024-08-31T12:22:50.282 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-08-31T12:22:50.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34941.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34941.log.gzgzip 2024-08-31T12:22:50.283 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40871.log 2024-08-31T12:22:50.284 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28780.log 2024-08-31T12:22:50.284 INFO:teuthology.orchestra.run.smithi164.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34975.log.gz 2024-08-31T12:22:50.284 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41007.log 2024-08-31T12:22:50.284 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40871.log.gz 2024-08-31T12:22:50.286 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2024-08-31T12:22:50.286 INFO:teuthology.orchestra.run.smithi164.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.28780.log.gz 2024-08-31T12:22:50.286 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28996.log 2024-08-31T12:22:50.286 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41007.log.gz 2024-08-31T12:22:50.287 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2024-08-31T12:22:50.287 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2024-08-31T12:22:50.287 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2024-08-31T12:22:50.288 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28996.log.gz 2024-08-31T12:22:50.289 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40140.log 2024-08-31T12:22:50.289 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2024-08-31T12:22:50.289 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35479.log 2024-08-31T12:22:50.289 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2024-08-31T12:22:50.290 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40140.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23927.log 2024-08-31T12:22:50.291 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40140.log.gz 2024-08-31T12:22:50.291 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35866.log 2024-08-31T12:22:50.291 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35479.log.gz 2024-08-31T12:22:50.292 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29408.log 2024-08-31T12:22:50.293 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.tmp-client.admin.23927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-08-31T12:22:50.293 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23927.log.gz 2024-08-31T12:22:50.294 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29507.log 2024-08-31T12:22:50.294 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35866.log.gz 2024-08-31T12:22:50.294 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39788.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz 2024-08-31T12:22:50.294 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36063.log 2024-08-31T12:22:50.304 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42070.log 2024-08-31T12:22:50.304 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29507.log.gz 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38237.log 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36063.log.gz 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35870.log 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42070.log.gz 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38237.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-31T12:22:50.305 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28750.log 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35870.log.gz 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29032.log 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28812.log 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.28750.log.gz 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29032.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.29032.log.gz 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2024-08-31T12:22:50.306 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.28812.log.gz 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35876.log 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-08-31T12:22:50.307 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35876.log.gz 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29336.log 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29408.log.gz 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29312.log 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29336.log.gz 2024-08-31T12:22:50.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29384.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29312.log.gz 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29384.log.gz 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-31T12:22:50.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr:gzip/var/log/ceph/ceph-mds.d.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29487.log 2024-08-31T12:22:50.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-31T12:22:50.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29487.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29487.log.gz 2024-08-31T12:22:50.312 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-31T12:22:50.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: 94.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-31T12:22:50.312 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29463.log 2024-08-31T12:22:50.316 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35108.log 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35082.log 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40605.log 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35108.log.gz 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-08-31T12:22:50.317 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35082.log.gz 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41331.log 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40605.log.gz 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35589.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41331.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41331.log.gz 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-08-31T12:22:50.318 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40819.log 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41473.log 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28825.log 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40819.log.gz 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.admin.41473.log: --verbose -- /var/log/ceph/ceph-client.admin.39920.log 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28825.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41473.log.gz 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28825.log.gz 2024-08-31T12:22:50.319 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2024-08-31T12:22:50.320 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41551.log 2024-08-31T12:22:50.320 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39920.log.gz 2024-08-31T12:22:50.320 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-08-31T12:22:50.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29439.log 2024-08-31T12:22:50.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29463.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29463.log.gz 2024-08-31T12:22:50.323 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41551.log.gz 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38080.log: -- /var/log/ceph/ceph-client.admin.41680.log 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28949.log 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-08-31T12:22:50.324 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41365.log 2024-08-31T12:22:50.325 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41680.log.gz 2024-08-31T12:22:50.325 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40168.log 2024-08-31T12:22:50.325 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28949.log.gz 2024-08-31T12:22:50.325 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41365.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41365.log.gz 2024-08-31T12:22:50.325 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36265.log 2024-08-31T12:22:50.326 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42483.log 2024-08-31T12:22:50.327 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40168.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40168.log.gz 2024-08-31T12:22:50.327 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36265.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36265.log.gz 2024-08-31T12:22:50.327 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28972.log 2024-08-31T12:22:50.327 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36078.log 2024-08-31T12:22:50.327 INFO:teuthology.orchestra.run.smithi164.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2024-08-31T12:22:50.328 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28972.log.gz 2024-08-31T12:22:50.329 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42096.log 2024-08-31T12:22:50.329 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36078.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36078.log.gz 2024-08-31T12:22:50.329 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2024-08-31T12:22:50.330 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36085.log 2024-08-31T12:22:50.330 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42096.log: /var/log/ceph/ceph-client.admin.40576.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42096.log.gz 2024-08-31T12:22:50.331 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2024-08-31T12:22:50.331 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-08-31T12:22:50.331 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36085.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.36085.log.gz --verbose 2024-08-31T12:22:50.332 INFO:teuthology.orchestra.run.smithi164.stderr: -- /var/log/ceph/ceph-client.admin.35797.log 2024-08-31T12:22:50.332 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.admin.38551.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38263.log 2024-08-31T12:22:50.333 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2024-08-31T12:22:50.337 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29419.log 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35797.log.gz 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38263.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38263.log.gz 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29419.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29419.log.gz 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34217.log 2024-08-31T12:22:50.338 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-08-31T12:22:50.339 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41914.log 2024-08-31T12:22:50.339 INFO:teuthology.orchestra.run.smithi164.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-08-31T12:22:50.341 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29360.log 2024-08-31T12:22:50.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29439.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29439.log.gz 2024-08-31T12:22:50.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29360.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29360.log.gz 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35667.log 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34217.log: /var/log/ceph/ceph-client.admin.41914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34217.log.gz 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35745.log 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41914.log.gz 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36281.log 2024-08-31T12:22:50.343 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35667.log.gz 2024-08-31T12:22:50.344 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41577.log 2024-08-31T12:22:50.344 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35745.log: 87.7%/var/log/ceph/ceph-client.admin.36281.log: -- replaced with /var/log/ceph/ceph-client.admin.35745.log.gz 2024-08-31T12:22:50.344 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-08-31T12:22:50.344 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36281.log.gz 2024-08-31T12:22:50.345 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-08-31T12:22:50.346 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41577.log.gz 2024-08-31T12:22:50.346 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36280.log: -- /var/log/ceph/ceph-client.admin.36278.log 2024-08-31T12:22:50.346 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-08-31T12:22:50.346 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28984.log 2024-08-31T12:22:50.346 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-08-31T12:22:50.347 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28884.log 2024-08-31T12:22:50.347 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36278.log.gz 2024-08-31T12:22:50.348 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38317.log 2024-08-31T12:22:50.348 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28984.log.gz 2024-08-31T12:22:50.349 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28884.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.28884.log.gz 2024-08-31T12:22:50.349 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-31T12:22:50.350 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38317.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38317.log.gz 2024-08-31T12:22:50.350 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36079.log 2024-08-31T12:22:50.350 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-osd.3.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42306.log 2024-08-31T12:22:50.352 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35771.log 2024-08-31T12:22:50.352 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36079.log.gz 2024-08-31T12:22:50.353 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29020.log 2024-08-31T12:22:50.353 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42306.log.gz 2024-08-31T12:22:50.353 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2024-08-31T12:22:50.354 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35771.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35771.log.gz 2024-08-31T12:22:50.355 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38395.log 2024-08-31T12:22:50.355 INFO:teuthology.orchestra.run.smithi164.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.29020.log.gz 2024-08-31T12:22:50.356 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2024-08-31T12:22:50.356 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2024-08-31T12:22:50.357 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.admin.38395.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42410.log 2024-08-31T12:22:50.357 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38395.log.gz 2024-08-31T12:22:50.358 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28903.log 2024-08-31T12:22:50.358 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2024-08-31T12:22:50.358 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35029.log 2024-08-31T12:22:50.359 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42410.log.gz 2024-08-31T12:22:50.359 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.admin.28903.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2024-08-31T12:22:50.360 INFO:teuthology.orchestra.run.smithi164.stderr: 74.4% -- replaced with /var/log/ceph/ceph-client.admin.28903.log.gz 2024-08-31T12:22:50.361 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40714.log 2024-08-31T12:22:50.361 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35029.log.gz 2024-08-31T12:22:50.362 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2024-08-31T12:22:50.362 INFO:teuthology.orchestra.run.smithi164.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz 2024-08-31T12:22:50.362 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.admin.40714.log: --verbose -- /var/log/ceph/ceph-client.admin.36875.log 2024-08-31T12:22:50.363 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40714.log.gz 2024-08-31T12:22:50.364 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42174.log 2024-08-31T12:22:50.364 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gz 2024-08-31T12:22:50.365 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36499.log 2024-08-31T12:22:50.365 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2024-08-31T12:22:50.366 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2024-08-31T12:22:50.366 INFO:teuthology.orchestra.run.smithi164.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42174.log.gz 2024-08-31T12:22:50.367 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.admin.36499.log: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-31T12:22:50.367 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36499.log.gz 2024-08-31T12:22:50.368 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37985.log 2024-08-31T12:22:50.368 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2024-08-31T12:22:50.369 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35863.log 2024-08-31T12:22:50.370 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-08-31T12:22:50.370 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37985.log.gz 2024-08-31T12:22:50.371 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-08-31T12:22:50.372 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35863.log.gz 2024-08-31T12:22:50.373 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41784.log 2024-08-31T12:22:50.373 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-08-31T12:22:50.373 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38185.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-08-31T12:22:50.374 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-08-31T12:22:50.375 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42148.log 2024-08-31T12:22:50.375 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41784.log.gz 2024-08-31T12:22:50.376 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-08-31T12:22:50.376 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-08-31T12:22:50.377 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36289.log 2024-08-31T12:22:50.377 INFO:teuthology.orchestra.run.smithi164.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42148.log.gz 2024-08-31T12:22:50.379 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42509.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-08-31T12:22:50.379 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-08-31T12:22:50.379 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36289.log.gz 2024-08-31T12:22:50.380 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40955.log 2024-08-31T12:22:50.381 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-08-31T12:22:50.382 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-08-31T12:22:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40955.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40955.log.gz 2024-08-31T12:22:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41096.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-08-31T12:22:50.384 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-08-31T12:22:50.385 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35511.log 2024-08-31T12:22:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40220.log 2024-08-31T12:22:50.387 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-08-31T12:22:50.387 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35511.log.gz 2024-08-31T12:22:50.388 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-08-31T12:22:50.389 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40220.log: gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.36577.log -- replaced with /var/log/ceph/ceph-client.admin.40220.log.gz 2024-08-31T12:22:50.389 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-08-31T12:22:50.390 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38369.log 2024-08-31T12:22:50.390 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-08-31T12:22:50.391 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-08-31T12:22:50.391 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-08-31T12:22:50.392 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38369.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38369.log.gz 2024-08-31T12:22:50.393 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-08-31T12:22:50.394 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38421.log 2024-08-31T12:22:50.394 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-08-31T12:22:50.395 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41940.log 2024-08-31T12:22:50.395 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-08-31T12:22:50.396 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38421.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38421.log.gz 2024-08-31T12:22:50.397 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40923.log 2024-08-31T12:22:50.397 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41940.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41940.log.gz 2024-08-31T12:22:50.398 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-31T12:22:50.399 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2024-08-31T12:22:50.399 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40923.log.gz 2024-08-31T12:22:50.400 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35212.log 2024-08-31T12:22:50.401 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41758.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gz 2024-08-31T12:22:50.402 INFO:teuthology.orchestra.run.smithi164.stderr: 86.1%/var/log/ceph/ceph-client.admin.35212.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-08-31T12:22:50.403 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35212.log.gz 2024-08-31T12:22:50.404 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36473.log 2024-08-31T12:22:50.404 INFO:teuthology.orchestra.run.smithi184.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-31T12:22:50.405 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41888.log 2024-08-31T12:22:50.406 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-08-31T12:22:50.407 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36473.log.gz 2024-08-31T12:22:50.407 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-08-31T12:22:50.408 INFO:teuthology.orchestra.run.smithi164.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41888.log.gz 2024-08-31T12:22:50.408 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-08-31T12:22:50.408 INFO:teuthology.orchestra.run.smithi164.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-08-31T12:22:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42384.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-08-31T12:22:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41810.log 2024-08-31T12:22:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-08-31T12:22:50.412 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41810.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-08-31T12:22:50.413 INFO:teuthology.orchestra.run.smithi164.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41810.log.gz 2024-08-31T12:22:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40662.log 2024-08-31T12:22:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38159.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-08-31T12:22:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-08-31T12:22:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-08-31T12:22:50.415 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40662.log.gz 2024-08-31T12:22:50.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35563.log 2024-08-31T12:22:50.417 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-08-31T12:22:50.417 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28961.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-08-31T12:22:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36833.log 2024-08-31T12:22:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35186.log 2024-08-31T12:22:50.419 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35563.log.gz 2024-08-31T12:22:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.36833.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.36833.log.gz -5 2024-08-31T12:22:50.420 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42229.log 2024-08-31T12:22:50.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40549.log 2024-08-31T12:22:50.421 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35186.log.gz 2024-08-31T12:22:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41732.log 2024-08-31T12:22:50.422 INFO:teuthology.orchestra.run.smithi164.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42229.log.gz 2024-08-31T12:22:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40549.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40549.log.gz 2024-08-31T12:22:50.424 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41732.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41732.log.gz 2024-08-31T12:22:50.425 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-08-31T12:22:50.425 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2024-08-31T12:22:50.427 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40114.log 2024-08-31T12:22:50.427 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-08-31T12:22:50.428 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-08-31T12:22:50.428 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2024-08-31T12:22:50.429 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40114.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40114.log.gz 2024-08-31T12:22:50.429 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2024-08-31T12:22:50.430 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35877.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-08-31T12:22:50.431 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-08-31T12:22:50.432 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2024-08-31T12:22:50.432 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2024-08-31T12:22:50.433 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35160.log 2024-08-31T12:22:50.433 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-08-31T12:22:50.434 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35452.log 87.7% 2024-08-31T12:22:50.434 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2024-08-31T12:22:50.435 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35160.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-31T12:22:50.435 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35160.log.gz 2024-08-31T12:22:50.436 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39946.log 2024-08-31T12:22:50.436 INFO:teuthology.orchestra.run.smithi164.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35452.log.gz 2024-08-31T12:22:50.439 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.39946.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-31T12:22:50.439 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-31T12:22:50.439 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39946.log.gz 2024-08-31T12:22:50.440 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2024-08-31T12:22:50.441 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41171.log 2024-08-31T12:22:50.442 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40740.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2024-08-31T12:22:50.443 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41171.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41171.log.gz 2024-08-31T12:22:50.444 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-31T12:22:50.444 INFO:teuthology.orchestra.run.smithi164.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-31T12:22:50.445 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2024-08-31T12:22:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40688.log 2024-08-31T12:22:50.447 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41197.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2024-08-31T12:22:50.449 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2024-08-31T12:22:50.449 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40688.log.gz 2024-08-31T12:22:50.449 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2024-08-31T12:22:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42200.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-08-31T12:22:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.admin.36979.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-08-31T12:22:50.451 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2024-08-31T12:22:50.452 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39842.log 2024-08-31T12:22:50.453 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37057.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-08-31T12:22:50.454 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28837.log/var/log/ceph/ceph-client.admin.39842.log: 2024-08-31T12:22:50.455 INFO:teuthology.orchestra.run.smithi164.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39842.log.gz 2024-08-31T12:22:50.455 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42018.log 2024-08-31T12:22:50.456 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28837.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.28837.log.gz 2024-08-31T12:22:50.456 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41418.log 2024-08-31T12:22:50.458 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42018.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42018.log.gz 2024-08-31T12:22:50.459 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41862.log 2024-08-31T12:22:50.459 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41418.log.gz 2024-08-31T12:22:50.460 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28843.log 2024-08-31T12:22:50.461 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41862.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41862.log.gz 2024-08-31T12:22:50.462 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.admin.28843.log: --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-08-31T12:22:50.462 INFO:teuthology.orchestra.run.smithi164.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.28843.log.gz 2024-08-31T12:22:50.463 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-08-31T12:22:50.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40636.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-08-31T12:22:50.465 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40793.log 2024-08-31T12:22:50.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36068.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-08-31T12:22:50.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40793.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40793.log.gz 2024-08-31T12:22:50.467 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-08-31T12:22:50.468 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38107.log 2024-08-31T12:22:50.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37083.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-08-31T12:22:50.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38107.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38107.log.gz 2024-08-31T12:22:50.471 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log 2024-08-31T12:22:50.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-08-31T12:22:50.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41836.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-08-31T12:22:50.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40767.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-08-31T12:22:50.475 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-08-31T12:22:50.476 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-08-31T12:22:50.478 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36603.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-08-31T12:22:50.479 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36288.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-08-31T12:22:50.479 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2024-08-31T12:22:50.480 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35537.log 2024-08-31T12:22:50.482 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35693.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2024-08-31T12:22:50.482 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35537.log.gz 2024-08-31T12:22:50.483 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38028.log 2024-08-31T12:22:50.484 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35055.log 2024-08-31T12:22:50.486 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38028.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38028.log.gz 2024-08-31T12:22:50.486 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35055.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35055.log.gz 2024-08-31T12:22:50.487 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35823.log 2024-08-31T12:22:50.488 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-08-31T12:22:50.489 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35823.log.gz 2024-08-31T12:22:50.490 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.29008.log: 74.6% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-08-31T12:22:50.491 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-08-31T12:22:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-08-31T12:22:50.493 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40007.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-08-31T12:22:50.494 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37031.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-08-31T12:22:50.495 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-08-31T12:22:50.496 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28925.log 2024-08-31T12:22:50.498 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35868.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-08-31T12:22:50.498 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28925.log.gz 2024-08-31T12:22:50.498 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-08-31T12:22:50.500 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34833.log 2024-08-31T12:22:50.501 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39816.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-08-31T12:22:50.502 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.34833.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34833.log.gz 2024-08-31T12:22:50.502 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40981.log 2024-08-31T12:22:50.503 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40897.log 2024-08-31T12:22:50.505 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40981.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40981.log.gz 2024-08-31T12:22:50.506 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.40897.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40897.log.gz 2024-08-31T12:22:50.506 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2024-08-31T12:22:50.507 INFO:teuthology.orchestra.run.smithi184.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-31T12:22:50.507 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2024-08-31T12:22:50.509 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38133.log: 87.5%/var/log/ceph/ceph-client.admin.41525.log: -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2024-08-31T12:22:50.510 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2024-08-31T12:22:50.510 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-08-31T12:22:50.511 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28853.log 2024-08-31T12:22:50.513 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.39716.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-08-31T12:22:50.514 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28853.log.gz 2024-08-31T12:22:50.514 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35001.log 2024-08-31T12:22:50.515 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41251.log 2024-08-31T12:22:50.516 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35001.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-08-31T12:22:50.517 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41251.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41251.log.gz 2024-08-31T12:22:50.517 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41223.log 2024-08-31T12:22:50.519 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28896.log 2024-08-31T12:22:50.520 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41223.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41223.log.gz 2024-08-31T12:22:50.521 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28896.log: 74.5% -- replaced with /var/log/ceph/ceph-client.admin.28896.log.gz 2024-08-31T12:22:50.521 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37005.log 2024-08-31T12:22:50.522 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28865.log 2024-08-31T12:22:50.524 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37005.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37005.log.gz 2024-08-31T12:22:50.525 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36901.log 2024-08-31T12:22:50.525 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28865.log.gz 2024-08-31T12:22:50.526 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28793.log 2024-08-31T12:22:50.527 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36901.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36901.log.gz 2024-08-31T12:22:50.528 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28793.log: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.28793.log.gz 2024-08-31T12:22:50.528 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-08-31T12:22:50.529 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-08-31T12:22:50.531 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35874.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-08-31T12:22:50.535 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.e.log: 94.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-08-31T12:22:50.535 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28913.log 2024-08-31T12:22:50.537 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38211.log 2024-08-31T12:22:50.538 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.28913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28913.log.gz 2024-08-31T12:22:50.539 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38211.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38211.log.gz 2024-08-31T12:22:50.540 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41639.log 2024-08-31T12:22:50.541 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42044.log 2024-08-31T12:22:50.542 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41639.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41639.log.gz 2024-08-31T12:22:50.543 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.42044.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42044.log.gz 2024-08-31T12:22:50.543 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-08-31T12:22:50.545 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41706.log 2024-08-31T12:22:50.546 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36525.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-08-31T12:22:50.547 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.41706.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41706.log.gz 2024-08-31T12:22:50.547 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36630.log 2024-08-31T12:22:50.548 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38617.log 2024-08-31T12:22:50.550 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36630.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36630.log.gz 2024-08-31T12:22:50.551 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38617.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38617.log.gz 2024-08-31T12:22:50.553 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-31T12:22:50.930 INFO:teuthology.orchestra.run.smithi164.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-31T12:22:55.466 INFO:teuthology.orchestra.run.smithi184.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-31T12:22:55.646 INFO:teuthology.orchestra.run.smithi184.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-31T12:22:55.701 INFO:teuthology.orchestra.run.smithi164.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-31T12:22:56.184 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-31T12:22:56.624 INFO:teuthology.orchestra.run.smithi164.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-31T12:22:56.984 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-31T12:22:57.164 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-31T12:22:57.634 INFO:teuthology.orchestra.run.smithi164.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-31T12:22:59.573 INFO:teuthology.orchestra.run.smithi164.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-31T12:22:59.575 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-08-31T12:22:59.575 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m9.329s 2024-08-31T12:22:59.575 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m32.485s 2024-08-31T12:22:59.575 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m2.738s 2024-08-31T12:23:04.464 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-31T12:23:04.466 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-08-31T12:23:04.466 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m14.193s 2024-08-31T12:23:04.466 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m37.587s 2024-08-31T12:23:04.466 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m1.270s 2024-08-31T12:23:04.467 INFO:tasks.ceph:Archiving logs... 2024-08-31T12:23:04.468 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi164/log 2024-08-31T12:23:04.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T12:23:08.262 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi184/log 2024-08-31T12:23:08.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T12:23:12.671 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T12:23:12.680 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T12:23:12.680 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T12:23:12.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T12:23:12.756 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T12:23:12.765 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T12:23:12.765 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:23:12.769 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:23:12.781 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T12:23:12.781 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-08-31T12:23:12.782 INFO:teuthology.orchestra.run.smithi164.stdout:*hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.066 -0.881 1.039 2024-08-31T12:23:12.782 INFO:teuthology.orchestra.run.smithi164.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.091 -0.509 0.952 2024-08-31T12:23:12.782 INFO:teuthology.orchestra.run.smithi164.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.094 -1.294 0.887 2024-08-31T12:23:12.782 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-08-31T12:23:12.783 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T12:23:12.784 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-08-31T12:23:12.784 INFO:teuthology.orchestra.run.smithi184.stdout:+hv01.front.sepi 67.205.162.81 3 u 22 64 377 0.061 -1.039 1.587 2024-08-31T12:23:12.784 INFO:teuthology.orchestra.run.smithi184.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.094 -2.827 2.030 2024-08-31T12:23:12.784 INFO:teuthology.orchestra.run.smithi184.stdout:*hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.088 -2.112 1.187 2024-08-31T12:23:12.784 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-08-31T12:23:12.784 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T12:23:12.793 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T12:23:12.794 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T12:23:12.802 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T12:23:12.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T12:23:12.818 INFO:teuthology.task.internal:Duration was 1308.636662 seconds 2024-08-31T12:23:12.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T12:23:12.827 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T12:23:12.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T12:23:12.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T12:23:12.914 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T12:23:12.914 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-08-31T12:23:12.914 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T12:23:12.935 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-08-31T12:23:12.935 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T12:23:12.945 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T12:23:12.945 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T12:23:12.982 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T12:23:13.020 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T12:23:13.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T12:23:13.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T12:23:13.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T12:23:13.154 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T12:23:13.154 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T12:23:13.174 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T12:23:13.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T12:23:13.195 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:23:13.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:23:13.233 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-08-31T12:23:13.239 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-08-31T12:23:13.262 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:23:13.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:23:13.303 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:23:13.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:23:13.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T12:23:13.318 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T12:23:13.319 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi164 2024-08-31T12:23:13.319 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T12:23:13.374 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881495/remote/smithi184 2024-08-31T12:23:13.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T12:23:13.393 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T12:23:13.394 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T12:23:13.414 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T12:23:13.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T12:23:13.448 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T12:23:13.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T12:23:13.457 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T12:23:13.458 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T12:23:13.462 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T12:23:13.467 INFO:teuthology.orchestra.run.smithi164.stdout: 658135 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 12:23 /home/ubuntu/cephtest 2024-08-31T12:23:13.486 INFO:teuthology.orchestra.run.smithi184.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 12:23 /home/ubuntu/cephtest 2024-08-31T12:23:13.487 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T12:23:13.498 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T12:23:13.524 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} duration: 1308.6366624832153 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi164 with status 128: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fd7e59ff1765442eb737865420c640f9 status: fail success: false 2024-08-31T12:23:13.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T12:23:13.609 INFO:teuthology.run:FAIL